-- Logs begin at Tue 2022-05-10 19:33:04 UTC, end at Tue 2022-05-10 20:45:21 UTC. -- May 10 20:18:30.173254 dv-cinder-828806-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 20:18:30.182995 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 20:18:30 2022] *** May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: nodename: dv-cinder-828806-2-iscsi May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: machine: x86_64 May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: clock source: unix May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: pcre jit disabled May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: detected number of CPU cores: 4 May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: current working directory: / May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: detected binary path: /usr/bin/uwsgi-core May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: your processes number limit is 47680 May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: your memory page size is 4096 bytes May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: detected max file descriptor number: 2048 May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: lock engine: pthread robust mutexes May 10 20:18:30.183554 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: thunder lock: enabled May 10 20:18:30.184391 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 20:18:30.184391 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 20:18:30.228128 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: Python main interpreter initialized at 0x55ae1f6739c0 May 10 20:18:30.228128 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: python threads support enabled May 10 20:18:30.228128 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: your server socket listen backlog is limited to 100 connections May 10 20:18:30.228128 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: your mercy for graceful operations on workers is 90 seconds May 10 20:18:30.228452 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: mapped 403077 bytes (393 KB) for 2 cores May 10 20:18:30.228531 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: *** Operational MODE: preforking *** May 10 20:18:30.228778 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: *** uWSGI is running in multiple interpreter mode *** May 10 20:18:30.228778 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: spawned uWSGI master process (pid: 102735) May 10 20:18:30.228956 dv-cinder-828806-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 20:18:30.229515 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: spawned uWSGI worker 1 (pid: 102736, cores: 1) May 10 20:18:30.229853 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: spawned uWSGI worker 2 (pid: 102737, cores: 1) May 10 20:18:30.231157 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 20:18:31.409673 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:18:31.410463 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:18:32.128706 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:18:32.128706 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: from cryptography.utils import int_from_bytes May 10 20:18:32.129045 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:18:32.129045 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: from cryptography.utils import int_from_bytes May 10 20:18:32.135063 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:18:32.135063 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: from cryptography.utils import int_from_bytes May 10 20:18:32.135388 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:18:32.135388 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: from cryptography.utils import int_from_bytes May 10 20:18:34.676162 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:18:34.676777 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:18:34.676912 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:18:34.677298 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:18:34.677549 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:18:34.677930 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.678249 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.678565 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.678785 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:18:34.679171 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.679256 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:18:34.679335 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.679484 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.679569 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:18:34.679798 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.679885 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:18:34.680109 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.680194 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:18:34.680428 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.680523 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.680685 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.680818 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.681016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.681170 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.681335 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-2-iscsi {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.681491 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.681652 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.681822 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.681953 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.682134 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.682241 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.682448 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.682554 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.682765 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.682857 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.683091 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.683185 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.683352 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.683439 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.683675 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.683917 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.684124 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-2-iscsi {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.684306 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.684400 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.684608 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.684683 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.684917 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.685192 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.685333 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.685418 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.685547 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.685642 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.685857 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.685959 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.686817 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.686924 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.687133 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.687363 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.687461 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.687678 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.687765 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.688057 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.688167 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-2-iscsi {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.688371 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.688458 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.688705 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.688795 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.689033 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.689177 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.689346 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.689449 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.689667 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.689776 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.689978 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.690064 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.690301 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.690429 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.690610 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.690705 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.690917 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.691005 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-2-iscsi {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.691238 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.691324 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.691551 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.691637 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.691863 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.691955 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.692179 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.692302 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.692475 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.692602 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.692779 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.692912 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.693122 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.693267 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.693438 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.693592 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.693737 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.693897 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.694035 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.694222 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.694332 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.694539 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.694628 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.694853 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695001 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695168 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695260 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695467 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695562 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695712 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695799 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.695956 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.696065 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.696283 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.696379 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.696581 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.696668 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.696884 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.697003 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.697217 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.697318 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.697519 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.697605 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.697820 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.697910 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.698120 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.698220 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.698422 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.698508 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.698677 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.698762 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.698929 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.699015 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.699244 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.699336 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.699561 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.699646 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.699870 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.699956 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.700175 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.700261 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.700480 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.700579 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.700787 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.700882 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.701114 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.701204 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.701422 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.701525 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.702279 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.702376 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.702588 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.702685 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.702898 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.702993 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.703211 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.703296 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.703523 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.703607 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.703827 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.703921 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.704129 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.704214 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.704429 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.704554 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.704741 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.704840 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705070 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705158 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705368 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705452 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705615 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705710 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705907 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.705993 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.706206 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.706291 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.706516 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.706603 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.706816 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.706909 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.707121 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.707220 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.707422 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.707519 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.707716 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.707802 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.708016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.708101 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.708315 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.708402 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.708604 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.708690 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.708901 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.709030 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.709228 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.709327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.709526 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.709610 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.709825 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.709924 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.710124 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.710210 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.710421 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.710507 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.710717 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.710814 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.711020 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.711113 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.711319 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.711412 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.711617 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.711712 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.711916 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.712002 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.712215 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.712307 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.712516 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.712622 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.712814 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.712900 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.713135 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.713224 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.713436 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.713536 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.713737 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.713822 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.714036 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.714122 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.714346 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.714440 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.714647 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.714731 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.714944 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.715035 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.715245 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.715339 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.715535 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.715627 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.715837 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.715923 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.716138 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.716225 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.716436 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.716528 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.716734 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.716819 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.717052 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.717157 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.717380 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.717466 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.717679 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.717771 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.717978 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.718065 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.718275 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.718360 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.718570 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.718667 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.718863 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.718950 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.719171 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.719257 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.719475 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.719568 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.719773 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.719858 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.720069 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.720154 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.720365 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.720461 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.720663 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.720747 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.720963 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.721070 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.721285 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.721383 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.721584 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.721670 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.721881 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.721966 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.722194 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.722288 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.722509 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.722606 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.722815 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.722902 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.723118 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.723212 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.723440 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.723525 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.723758 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.723845 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:18:34.724064 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.724150 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.724371 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.724456 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.724677 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.724789 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.725007 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.725164 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.725325 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.725497 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.725648 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.725827 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.725957 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.726145 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.726265 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.726455 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.726576 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.726768 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.726881 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.727091 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.727235 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.727403 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.727490 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.727713 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.727808 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.728023 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.728109 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.728341 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.728433 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.728658 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.728745 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.729016 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.729117 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.729321 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.729408 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.729638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.729724 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.729956 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.730044 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.730261 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.730347 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.730567 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.730654 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.730886 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.730972 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.731203 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.731296 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.731510 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.731595 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.731824 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.731920 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.732133 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.732233 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.732441 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.732527 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.732747 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.732847 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.733105 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.733208 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.733418 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.733506 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.733731 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.733824 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.734043 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.734142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.734351 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.734437 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.734659 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.734746 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.734979 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.735080 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.735279 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.735408 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.735587 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.735671 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.735889 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.735988 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.736190 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.736277 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.736491 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.736577 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.736791 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.736878 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.737126 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.737236 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.737426 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.737523 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.737740 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.737840 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.738047 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.738133 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.738350 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.738436 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.738658 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.738746 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.738962 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.739055 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.739267 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.739360 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.739569 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.739663 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.739868 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.739964 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.740164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.740259 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.740469 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.740561 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.740770 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.740863 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.741090 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.741192 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.741408 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.741494 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.741713 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.741806 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.742012 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.742106 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.742330 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.742425 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.742632 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.742764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.742931 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.743027 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.743236 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.743321 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.743539 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.743626 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.743845 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.743940 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.744151 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.744245 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.744452 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.744545 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.744768 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.744855 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.745097 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.745193 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.745401 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.745488 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.745724 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.745819 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.746027 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.746114 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.746330 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.746422 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.746643 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.746730 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.746954 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.747041 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.747265 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.747369 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.747560 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.747648 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.747863 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.747957 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.748163 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.748264 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.748995 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.749091 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.749291 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.749388 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.749596 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.749696 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.749893 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.749978 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.750191 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.750280 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.750489 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.750584 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.750786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.750871 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.751082 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.751179 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.751397 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.751484 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.751699 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.751784 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.751995 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.752081 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.752291 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.752378 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.752588 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.752672 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.752895 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.753000 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.753220 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.753309 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.753528 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.753613 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.753829 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.753927 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.754130 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.754230 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.754430 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.754516 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.754748 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.754842 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.755053 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.755139 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.755357 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.755442 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.755654 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.755746 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.755952 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.756038 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.756255 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.756354 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.756568 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.756663 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.756873 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.756958 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.757214 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.757302 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.757521 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.757616 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.757839 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.757925 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.758143 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.758229 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.758456 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.758543 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.758752 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.758845 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.759062 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.759148 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.759393 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.759486 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.759709 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.759794 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.760019 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.760108 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.760327 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.760412 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.760629 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.760714 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.760937 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.761081 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.761266 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.761354 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.761573 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.761658 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.761876 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.761969 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.762181 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.762273 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.762491 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.762576 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.762795 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.762893 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.763105 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.763202 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.763409 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.763496 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.763724 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.763821 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.764027 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.764143 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.764891 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.764997 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.765229 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.765329 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.765542 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.765636 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.765854 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.765962 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.766162 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.766258 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.766475 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.766569 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.766782 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.766885 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.767093 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.767179 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.767645 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.767801 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.767957 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.768044 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.768263 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.768352 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.768560 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.768646 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.768858 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.768943 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.769186 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.769276 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.769493 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.769579 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.769796 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.769881 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.770100 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.770187 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.770398 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.770483 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.770704 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.770799 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771007 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771100 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771306 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771391 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771602 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771696 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771903 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.771988 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.772207 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.772292 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.772509 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.772606 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.772817 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.772915 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.773151 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.773240 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.773455 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.773550 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.773753 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.773839 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.774061 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.774153 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.774365 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.774458 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.774663 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.774748 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.774959 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.775050 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.775258 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.775345 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.775575 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.775666 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.775883 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.775976 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.776179 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.776265 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.776489 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.776578 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.776793 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.776879 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.777123 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.777283 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.777465 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.777562 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.777740 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.777875 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.778040 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.778133 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.778341 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.778427 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.778643 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.778737 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.778943 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.779029 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.779248 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.779334 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.779554 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.779652 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.779884 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.779970 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.780187 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.780272 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.780495 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.780594 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.780796 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.780888 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.781125 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.781213 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.781428 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.781523 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.781724 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.781810 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.782027 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.782112 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.782335 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.782428 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.782647 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.782895 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.782980 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.783224 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.783318 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.783534 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.783627 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.783848 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.783946 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.784153 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.784248 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.784462 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.784548 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.784768 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.784854 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.785093 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.785195 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.785402 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.785487 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.785717 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.785816 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.786018 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.786280 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.786375 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.786605 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.786691 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.786910 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.787003 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.787215 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.787309 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.787514 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.787607 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.787812 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.787899 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.788116 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.788212 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.788413 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.788499 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.788711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.788797 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.789026 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.789136 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.789329 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.789416 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.789637 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.789764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.789935 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.790032 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.790239 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.790325 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.790536 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.790630 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.790849 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.790944 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.791148 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.791241 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.791442 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.791534 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.791738 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.791899 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.792036 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.792123 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.792333 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.792418 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.792637 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.792725 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.792948 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.793096 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.793271 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.793357 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.793587 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.793685 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.793889 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.793974 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.794187 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.794273 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.794498 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.794584 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.794793 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.794877 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.795090 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.795188 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.795407 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.795541 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.795712 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.795799 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.796015 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.796155 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.796311 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.796397 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.796615 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.796701 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.796918 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.797034 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.797253 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.797340 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.797572 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.797707 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.797851 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.797947 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.798153 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.798241 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.798449 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.798535 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.798756 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.798843 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.799056 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.799149 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.799352 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.799439 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.799646 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.799733 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.799947 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.800045 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.800248 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.800335 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.800542 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.800629 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.800844 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.800928 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.801161 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.801247 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.801465 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.801552 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.801757 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.801843 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.802051 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.802145 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.802346 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.802432 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.802641 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.802733 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.802940 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.803038 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.803232 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.803324 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.803542 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.803633 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.803840 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.803939 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.804134 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.804219 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.804429 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.804521 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.804730 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.804830 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.805047 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.805138 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.805344 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.805430 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.805641 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.805729 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.805947 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.806033 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.806251 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.806337 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.806544 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.806630 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.806847 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.806940 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.807149 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.807235 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.807443 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.807536 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.807738 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.807827 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.808035 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.808127 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.808328 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.808415 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.808621 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.808706 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.808915 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.809041 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.809237 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.809332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.809532 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.809625 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.809838 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.809933 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.810136 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.810229 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.810430 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.810517 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.810724 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.810818 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.811531 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.811627 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.811833 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.811925 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.812133 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.812233 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.812431 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.812525 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.812731 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.812817 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.813053 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.813143 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.813354 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.813439 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.813670 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.813755 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.813972 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.814058 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.814271 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.814364 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.814568 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.814652 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.814862 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.814948 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.815168 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.815253 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.815476 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.815561 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.815777 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.815872 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.816071 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.816166 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.816387 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.816489 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.816692 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.816780 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.817015 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.817115 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.817326 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.817421 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.817638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.817724 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.817940 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.818035 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.818240 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.818335 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.818544 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.818630 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.818849 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.818937 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.819150 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.819243 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.819448 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.819534 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.819751 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.819837 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.820055 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.820221 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.820360 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.820448 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.820666 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.820752 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.820990 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.821080 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.821297 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.821383 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.821595 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.821682 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.821901 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.821987 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.822201 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.822287 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.822499 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.822586 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.822804 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.822890 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.823108 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.823203 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.823406 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.823492 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.823710 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.823803 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.824007 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.824101 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.824311 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.824407 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.824610 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.824696 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.825020 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.825110 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.825330 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.825432 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.825640 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.825727 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.825945 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.826034 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.826249 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.826344 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.826580 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.827174 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.827407 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.827492 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.827721 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.827818 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.828028 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.828123 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.828340 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.828462 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.828645 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.828769 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.829091 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.829179 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.829396 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.829481 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.829697 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.829784 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.829993 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.830079 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.830296 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.830383 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.830604 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.830690 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.830902 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.830994 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.831199 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.831285 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.831496 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.831583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.831810 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.831929 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.832108 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.832245 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.832420 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.832557 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.832827 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.832915 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.833160 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.833258 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.833460 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.833547 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.833783 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.833868 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.834115 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.834210 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.834422 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.834516 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.834726 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.834819 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.835029 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.835173 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.835351 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.835447 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.835646 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.835732 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.835953 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.836040 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.836258 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.836366 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.836576 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.836678 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.836888 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.837003 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.837219 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.837397 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.837530 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.837709 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.837835 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.838020 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.838149 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.838341 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.838462 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.838663 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.838749 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.838985 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.839079 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.839288 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.839458 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.839602 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.839775 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.839914 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.840079 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.840238 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.840395 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.840558 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.840712 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.840869 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.841034 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.841207 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.841335 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.841512 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.841640 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.841833 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.841942 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.842152 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.842264 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.842487 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.842574 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.842806 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.842900 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.843145 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.843231 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.843450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.843536 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.843753 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.843841 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.844051 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.844137 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.844349 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.844444 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.844664 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.844760 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.844962 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.845078 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.845309 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.845404 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.845618 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.845705 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.845918 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.846044 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.846236 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.846333 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.846536 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.846669 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.846843 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.846929 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.847144 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.847239 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.847442 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.847536 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.847742 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.847835 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.848037 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.848131 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.848356 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.848451 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.848657 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.848753 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.848997 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.849087 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.849303 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.849401 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.849621 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.849714 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.849927 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.850015 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.850256 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.850356 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.850564 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.850660 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.850871 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.850958 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.851173 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.851266 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.851477 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.851577 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.851778 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.851865 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.852076 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.852162 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.852380 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.852476 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.852680 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.852774 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.852991 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.853127 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.853298 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.853404 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.853600 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.853695 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.853896 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.853984 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.854194 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.854292 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.854492 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.854586 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.854805 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.854893 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.855101 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.855188 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.855415 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.855511 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.855717 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.855805 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.856014 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.856140 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.856311 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.856405 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.856606 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.856698 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.856909 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.857014 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.857240 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.857327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.857542 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.857627 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.857864 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.857954 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.858168 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.858292 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.858486 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.858582 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.858787 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.858876 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.859104 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.859192 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.859410 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.859542 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.859711 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.859798 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.860010 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.860096 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.860310 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.860405 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.860616 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.860702 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.860926 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.861074 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.861260 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.861361 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.861566 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.861652 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.861874 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.861961 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.862183 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.862278 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.862488 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.862574 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.862809 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.863002 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.863116 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.863331 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.863419 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.863645 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.863731 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.863956 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.864051 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.864265 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.864351 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.864573 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.864660 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.864881 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.864995 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.865216 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.865306 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.865524 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.865612 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.865830 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.865919 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.866135 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.866261 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.866456 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.866652 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.866812 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.866987 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.867075 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.867306 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.867399 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.867618 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.867733 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.867931 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.868035 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.868244 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.868331 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.868559 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.868656 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.868872 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.869008 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.869207 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.869297 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.869516 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.869603 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.869825 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.869912 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.870134 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.870233 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.870443 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.870529 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.870750 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.870837 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.871056 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.871152 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.871363 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.871449 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.871670 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.871756 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.871977 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.872073 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.872282 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.872376 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.872587 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.872681 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.872894 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.872999 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.873243 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.873331 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.874069 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.874169 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.874390 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.874486 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.874695 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.874788 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.875003 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.875089 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.875311 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.875398 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.875620 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.875822 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.875931 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.876131 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.876241 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.876458 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.876548 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.876774 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.876861 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.877116 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.877216 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.877425 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.877524 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.877736 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.877823 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.878054 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.878143 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.878360 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.878455 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.878659 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.878763 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.878975 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.879070 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.879279 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.879487 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.879582 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.879802 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.879890 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.880132 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.880228 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.880454 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.880540 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.880765 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.880897 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.881093 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.881182 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.881407 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.881621 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.881722 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.881957 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.882043 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.882268 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.882356 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.882588 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.882675 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.882895 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.882981 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.883197 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.883290 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.883495 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.883582 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.883810 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.883898 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.884108 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.884206 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.884407 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.884496 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.884716 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.884804 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.885054 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.885292 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.885414 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.885634 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.885735 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.885936 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.886033 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.886239 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.886337 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.886536 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.886641 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.886840 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.886937 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.887138 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.887236 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.887458 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.887557 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.887757 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.887854 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.888056 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.888153 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.888358 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.888454 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.888664 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.888767 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.888959 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.889147 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.889829 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.889970 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.890133 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.890230 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.890433 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.890520 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.890731 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.890817 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.891026 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.891125 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.891328 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.891415 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.891625 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.891712 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.891928 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.892025 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.892225 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.892311 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.892775 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.892866 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.893109 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.893212 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.893414 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.893536 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.893717 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.893804 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.894019 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.894114 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.894324 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.894410 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.894627 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.894713 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.894926 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.895019 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.895231 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.895317 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.895534 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.895620 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.895837 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.895932 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.896138 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.896225 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.896444 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.896679 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.896775 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.897026 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.897130 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.897347 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.897444 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.897668 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.897769 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.897989 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.898091 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.898295 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.898380 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.898592 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.898678 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.898893 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.898989 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.899202 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.899303 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.899503 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.899590 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.899807 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.899895 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.900109 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.900354 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.900454 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.900685 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.900772 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.901007 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.901095 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.901314 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.901403 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.901614 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.901710 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.901916 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.902003 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.902218 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.902307 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.902518 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.902604 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.902818 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.902903 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.903124 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.903219 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.903426 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.903512 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.903732 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.903896 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.904040 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.904136 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.904345 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.904434 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.904664 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.904763 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.905002 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.905093 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.905311 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.905409 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.905614 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.905711 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.905918 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.906005 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.906226 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.906312 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.906536 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.906623 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.906841 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.906927 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.907141 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.907228 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.907477 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.907575 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.907788 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.907875 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.908099 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.908185 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.908411 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.908501 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.908718 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.908804 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.909045 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.909165 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.909354 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.909443 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.909657 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.909752 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.909964 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.910059 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.910265 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.910394 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.910586 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.910674 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.910894 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.910990 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.911223 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.911309 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.911539 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.911627 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.911837 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.911925 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.912133 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.912227 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.912429 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.912517 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.912730 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.912818 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.913063 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.913153 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.913369 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.913468 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.913667 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.913755 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.913961 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.914048 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.914263 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.914350 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.914559 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.914654 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.914855 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.914974 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.915151 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.915296 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.915448 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.915608 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.915749 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.915910 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.916042 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.916211 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.916337 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.916516 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.916631 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.916831 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.916929 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.917161 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.917250 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.917465 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.917583 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.917766 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.917877 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.918072 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.918169 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.918374 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.918471 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.918666 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.918771 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.918963 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.919063 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.919254 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.919378 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.919558 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.919654 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.919857 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.919957 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.920157 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.920244 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.920484 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.920581 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.920784 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.920871 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.921105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.921195 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.921410 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.921506 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.921716 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.921802 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922015 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922110 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922313 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922401 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922613 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922699 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922910 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.922996 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.923209 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.923297 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.923516 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.923601 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.923821 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.923907 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.924124 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.924212 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.924427 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.924521 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.924740 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.924836 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.925081 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.925169 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.925400 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.925488 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.925699 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.925800 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.926014 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.926108 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.926372 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.926466 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.926639 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.926739 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.926945 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.927041 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.927250 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.927336 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.927573 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.927697 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.927878 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.927975 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.928184 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.928279 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.928491 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.928588 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.928793 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.928890 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.929119 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.929217 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.929431 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.929581 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.929738 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.929871 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.930053 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.930191 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.930367 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.930505 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.930680 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.930817 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.930991 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.931137 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.931300 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.931460 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.931619 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.931751 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.931924 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.932141 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.932279 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.932413 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.932549 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.932686 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.932832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.933008 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.933142 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.933231 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.933378 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:18:34.933476 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.933759 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.934082 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.934409 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.934730 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.935052 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.935393 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.935704 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.936562 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.936890 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.937231 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.937542 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.937848 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:18:34.938087 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:18:34.957089 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:34.961169 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:35.022252 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.context [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),163eff52-bb1b-4861-a806-bd9b77af6c50(cell1) {{(pid=102736) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:18:35.025658 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.context [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),163eff52-bb1b-4861-a806-bd9b77af6c50(cell1) {{(pid=102737) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:18:35.026546 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:35.028117 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:35.028902 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:35.030630 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:35.031419 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:35.032204 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:35.033001 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:18:35.034929 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_concurrency.lockutils [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:18:35.043225 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:35.046423 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:35.049672 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:35.052419 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:35.207690 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_db.sqlalchemy.engines [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:35.215162 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG oslo_db.sqlalchemy.engines [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:18:35.548737 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:18:35.555221 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:18:35.556038 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:18:35.562589 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:18:35.909146 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:18:35.915273 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: WARNING keystonemiddleware.auth_token [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:18:35.921769 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:18:35.922141 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae1f6739c0 pid: 102736 (default app) May 10 20:18:35.923949 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:18:35.925147 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 May 10 20:18:35.925568 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Tue May 10 20:18:35 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:18:35.927878 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: WARNING keystonemiddleware.auth_token [None req-dae50c7c-c531-4a8a-b234-d9cb1cea019e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:18:35.934073 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ae1f6739c0 pid: 102737 (default app) May 10 20:19:53.221586 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:53.222587 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 10 20:19:53.222994 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 2/2] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:53.640694 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-386171d0-648c-4eb7-854b-bd30f565b7cf admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:53.670162 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-386171d0-648c-4eb7-854b-bd30f565b7cf admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.439679 May 10 20:19:53.670819 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1291 bytes} [Tue May 10 20:19:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:19:55.952584 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:55.953600 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-a744f7a6-73e4-4929-b8fa-7d73015ef804 None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 10 20:19:55.953996 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 3/4] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:56.019500 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-59aca8f7-76d1-451b-84e5-5ed186b49caf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "disk": 1, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:56.038394 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:19:56.038394 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: warnings.warn(msg) May 10 20:19:56.066240 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-59aca8f7-76d1-451b-84e5-5ed186b49caf admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106299 May 10 20:19:56.066944 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 2/5] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:19:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:19:56.284143 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-3da5ddf4-45a6-404c-b7f8-d44c34431411 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:56.286632 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:19:56.286632 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 10 20:19:56.338559 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-3da5ddf4-45a6-404c-b7f8-d44c34431411 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.263530 May 10 20:19:56.339346 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 4/6] 10.222.0.61 () {64 vars in 1335 bytes} [Tue May 10 20:19:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:19:58.610361 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-59aca8f7-76d1-451b-84e5-5ed186b49caf admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:19:58.612081 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-59aca8f7-76d1-451b-84e5-5ed186b49caf admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 May 10 20:19:58.613004 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 3/7] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:19:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:19:58.726203 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-c3f91212-a83d-489e-90e6-7e586d733524 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "ram": 512, "vcpus": 1, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:58.744298 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:19:58.744298 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 10 20:19:58.761732 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-c3f91212-a83d-489e-90e6-7e586d733524 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142047 May 10 20:19:58.762384 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 5/8] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:19:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:19:58.774366 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-4fa8e870-b698-4a01-b592-55312c45932f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:19:58.775838 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:19:58.775838 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: warnings.warn(msg) May 10 20:19:58.807160 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-4fa8e870-b698-4a01-b592-55312c45932f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036332 May 10 20:19:58.807712 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 4/9] 10.222.0.61 () {64 vars in 1335 bytes} [Tue May 10 20:19:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:01.126880 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-c3f91212-a83d-489e-90e6-7e586d733524 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:01.129433 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-c3f91212-a83d-489e-90e6-7e586d733524 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002985 May 10 20:20:01.130507 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 6/10] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:01.200402 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-270d9360-4016-4679-9708-272cd96322c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "disk": 10}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:01.218076 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-270d9360-4016-4679-9708-272cd96322c6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080785 May 10 20:20:01.225117 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 5/11] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:01.231291 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-29537957-3a0c-48c0-858e-ef9c151be565 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:01.255283 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-29537957-3a0c-48c0-858e-ef9c151be565 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028668 May 10 20:20:01.255969 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 7/12] 10.222.0.61 () {64 vars in 1335 bytes} [Tue May 10 20:20:01 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:03.517240 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-270d9360-4016-4679-9708-272cd96322c6 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:03.518638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-270d9360-4016-4679-9708-272cd96322c6 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001893 May 10 20:20:03.519126 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 6/13] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:03.579313 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-f2775fdf-119d-4a2d-bc39-850e603af541 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:03.596675 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-f2775fdf-119d-4a2d-bc39-850e603af541 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071232 May 10 20:20:03.598053 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 8/14] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:20:03.609398 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-66d1a895-86c3-4f1a-8646-7954b6f24059 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:03.633681 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-66d1a895-86c3-4f1a-8646-7954b6f24059 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028471 May 10 20:20:03.634298 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 7/15] 10.222.0.61 () {64 vars in 1335 bytes} [Tue May 10 20:20:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:05.916778 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-f2775fdf-119d-4a2d-bc39-850e603af541 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:05.917818 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-f2775fdf-119d-4a2d-bc39-850e603af541 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 10 20:20:05.918248 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 9/16] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:05.982062 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-1471abfe-cc08-4256-bd94-449277ebd028 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:06.000681 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-1471abfe-cc08-4256-bd94-449277ebd028 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076627 May 10 20:20:06.001460 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 8/17] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:06.013828 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-c5c0f39b-d536-4764-9421-07354ba88ac1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:06.036860 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-c5c0f39b-d536-4764-9421-07354ba88ac1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027391 May 10 20:20:06.037805 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 10/18] 10.222.0.61 () {64 vars in 1335 bytes} [Tue May 10 20:20:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:08.322013 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-1471abfe-cc08-4256-bd94-449277ebd028 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:08.323041 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-1471abfe-cc08-4256-bd94-449277ebd028 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 10 20:20:08.323642 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 9/19] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:08.384314 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-5212d98c-89f0-4aab-a15b-c17c4656a1d3 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:08.407995 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-5212d98c-89f0-4aab-a15b-c17c4656a1d3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077643 May 10 20:20:08.408534 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 11/20] 10.222.0.61 () {60 vars in 1291 bytes} [Tue May 10 20:20:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:10.691044 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-1471abfe-cc08-4256-bd94-449277ebd028 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:10.692077 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-1471abfe-cc08-4256-bd94-449277ebd028 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 10 20:20:10.692480 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 10/21] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:10.767340 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-22146f86-48d2-467e-b101-009e2dccb8d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "swap": 0}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:10.799860 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-22146f86-48d2-467e-b101-009e2dccb8d0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.100353 May 10 20:20:10.800767 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 12/22] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:10.817417 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-ad533c81-01ca-42ef-954d-f44450054a81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:10.847459 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-ad533c81-01ca-42ef-954d-f44450054a81 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035018 May 10 20:20:10.848285 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 11/23] 10.222.0.61 () {64 vars in 1332 bytes} [Tue May 10 20:20:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:13.296561 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-22146f86-48d2-467e-b101-009e2dccb8d0 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:13.297603 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-22146f86-48d2-467e-b101-009e2dccb8d0 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 10 20:20:13.298007 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 13/24] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:13.358227 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-b9fa2dcb-bd3b-455f-b84a-3aac81639bf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "vcpus": 1, "disk": 20, "rxtx_factor": 1.0}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:13.381104 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-b9fa2dcb-bd3b-455f-b84a-3aac81639bf7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076823 May 10 20:20:13.381883 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 12/25] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:20:13.393811 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-774545a2-1b8c-4086-a27c-11eabcba06ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:13.415805 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-774545a2-1b8c-4086-a27c-11eabcba06ae admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025994 May 10 20:20:13.416380 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 14/26] 10.222.0.61 () {64 vars in 1332 bytes} [Tue May 10 20:20:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:15.670226 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-b9fa2dcb-bd3b-455f-b84a-3aac81639bf7 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:15.671327 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-b9fa2dcb-bd3b-455f-b84a-3aac81639bf7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 10 20:20:15.671829 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 13/27] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:15.728040 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-00841cc6-bdbf-4b43-9826-00f28b75bab7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "disk": 40, "vcpus": 2, "swap": 0, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:15.745613 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-00841cc6-bdbf-4b43-9826-00f28b75bab7 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.068229 May 10 20:20:15.746351 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 15/28] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:15 2022] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:20:15.758166 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-365bb32e-bb2a-4579-8f55-b408137e6d0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:15.779413 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-365bb32e-bb2a-4579-8f55-b408137e6d0d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024913 May 10 20:20:15.779973 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 14/29] 10.222.0.61 () {64 vars in 1332 bytes} [Tue May 10 20:20:15 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:18.055975 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-00841cc6-bdbf-4b43-9826-00f28b75bab7 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:18.057085 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-00841cc6-bdbf-4b43-9826-00f28b75bab7 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 May 10 20:20:18.057523 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 16/30] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:18.119293 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6aff7436-4522-40a6-af2d-d0df9a0d0948 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "ram": 8192}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:18.139411 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6aff7436-4522-40a6-af2d-d0df9a0d0948 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075566 May 10 20:20:18.139960 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 15/31] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:20:18.151997 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-7b0e6bd8-67f7-4719-8258-381a05a0a528 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:18.173547 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-7b0e6bd8-67f7-4719-8258-381a05a0a528 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025244 May 10 20:20:18.174128 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 17/32] 10.222.0.61 () {64 vars in 1332 bytes} [Tue May 10 20:20:18 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:20:20.453570 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-6aff7436-4522-40a6-af2d-d0df9a0d0948 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:20.454804 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-6aff7436-4522-40a6-af2d-d0df9a0d0948 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 May 10 20:20:20.455452 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 16/33] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:20.554861 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-6a9a7d6a-5865-40be-bcf8-60eea1cead25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "name": "m1.xlarge"}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:20.687503 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-6a9a7d6a-5865-40be-bcf8-60eea1cead25 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.226495 May 10 20:20:20.688310 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 18/34] 10.222.0.61 () {64 vars in 1282 bytes} [Tue May 10 20:20:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:20.700352 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-1c879eb0-508e-439d-9abc-c30a2896ae14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:20.722384 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-1c879eb0-508e-439d-9abc-c30a2896ae14 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026158 May 10 20:20:20.722974 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 17/35] 10.222.0.61 () {64 vars in 1332 bytes} [Tue May 10 20:20:20 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:20:45.013430 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-6a9a7d6a-5865-40be-bcf8-60eea1cead25 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:45.014435 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-6a9a7d6a-5865-40be-bcf8-60eea1cead25 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 May 10 20:20:45.014833 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 19/36] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:45.070809 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-4cdcc4a4-dcd8-49ae-8cf0-267cf148fd7e admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:45.087354 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-4cdcc4a4-dcd8-49ae-8cf0-267cf148fd7e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066494 May 10 20:20:45.087888 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1291 bytes} [Tue May 10 20:20:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:46.089763 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-6a9a7d6a-5865-40be-bcf8-60eea1cead25 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:46.090764 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-6a9a7d6a-5865-40be-bcf8-60eea1cead25 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 May 10 20:20:46.091201 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 20/38] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:46.306248 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-3024291f-ca39-4fbe-b2a0-15490247796d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:46.312371 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-3024291f-ca39-4fbe-b2a0-15490247796d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-3024291f-ca39-4fbe-b2a0-15490247796d admin admin] Request method failure captured: May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Accept: application/json May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Accept-Encoding: gzip, deflate May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Connection: keep-alive May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Content-Length: 0 May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Host: 10.222.0.61 May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Openstack-Api-Version: compute 2.90 May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Openstack-System-Scope: None May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: User-Agent: python-novaclient May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Auth-Token: gAAAAABieske_nrbW-zaNxh5PdcAeJCLk4lb--HOoc7lCacSyvDd2PbUk1u3PYDTIp_uLEBoCBNVlTkBY7DBaYs9BZUsL9nKhlF_K4tEGKoWiKMAw5irGqx-nV7VN5idgqjLFbd_a0JYLkHpsspg8ppbaWdleF1PVtOn8izfWZYEyhGjBcukBYo May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Domain-Id: None May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Domain-Name: None May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Identity-Status: Confirmed May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Is-Admin-Project: True May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Domain-Id: default May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Domain-Name: Default May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Name: admin May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Role: admin,member,reader May 10 20:20:46.315583 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Roles: admin,member,reader May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_92bd0a8a7f7646abb6287b06cfd28dac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant: admin May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant-Name: admin May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User: admin May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Domain-Id: default May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Domain-Name: Default May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Id: caf7948704bc4cd8813f309af89db439 May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Name: admin May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: method: > May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: exception: Flavor 42 could not be found. May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: action_args: {'id': '42'} May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:46.317320 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:46.318332 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:46.319852 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-3024291f-ca39-4fbe-b2a0-15490247796d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:46.321192 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-3024291f-ca39-4fbe-b2a0-15490247796d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061142 May 10 20:20:46.321192 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 19/39] 10.222.0.61 () {60 vars in 1190 bytes} [Tue May 10 20:20:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:20:46.326597 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-8f77384c-7c61-48b8-82ac-7a60641624c4 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:46.347827 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-8f77384c-7c61-48b8-82ac-7a60641624c4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024791 May 10 20:20:46.348366 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 21/40] 10.222.0.61 () {60 vars in 1210 bytes} [Tue May 10 20:20:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:46.360937 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-b93bd994-c3d9-4f5d-be77-cdfd49cf7d5e admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:46.382260 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-b93bd994-c3d9-4f5d-be77-cdfd49cf7d5e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025296 May 10 20:20:46.382780 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 20/41] 10.222.0.61 () {60 vars in 1210 bytes} [Tue May 10 20:20:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:46.391553 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-aa879f63-2ca5-474f-b2ec-d0f1b2cc5668 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:46.397252 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.wsgi [None req-aa879f63-2ca5-474f-b2ec-d0f1b2cc5668 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-aa879f63-2ca5-474f-b2ec-d0f1b2cc5668 admin admin] Request method failure captured: May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Accept: application/json May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Accept-Encoding: gzip, deflate May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Connection: keep-alive May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Content-Length: 0 May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Host: 10.222.0.61 May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Openstack-Api-Version: compute 2.90 May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Openstack-System-Scope: None May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: User-Agent: python-novaclient May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Auth-Token: gAAAAABieske_nrbW-zaNxh5PdcAeJCLk4lb--HOoc7lCacSyvDd2PbUk1u3PYDTIp_uLEBoCBNVlTkBY7DBaYs9BZUsL9nKhlF_K4tEGKoWiKMAw5irGqx-nV7VN5idgqjLFbd_a0JYLkHpsspg8ppbaWdleF1PVtOn8izfWZYEyhGjBcukBYo May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Domain-Id: None May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Domain-Name: None May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Identity-Status: Confirmed May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Is-Admin-Project: True May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Domain-Id: default May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Domain-Name: Default May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Name: admin May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Role: admin,member,reader May 10 20:20:46.400446 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Roles: admin,member,reader May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_92bd0a8a7f7646abb6287b06cfd28dac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant: admin May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant-Name: admin May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User: admin May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Domain-Id: default May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Domain-Name: Default May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Id: caf7948704bc4cd8813f309af89db439 May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Name: admin May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: method: > May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: exception: Flavor 42 could not be found. May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: action_args: {'id': '42'} May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:46.402011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:46.403016 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:46.404316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-aa879f63-2ca5-474f-b2ec-d0f1b2cc5668 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:46.405586 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-aa879f63-2ca5-474f-b2ec-d0f1b2cc5668 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013750 May 10 20:20:46.405586 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 22/42] 10.222.0.61 () {60 vars in 1190 bytes} [Tue May 10 20:20:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 20:20:47.284330 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-b93bd994-c3d9-4f5d-be77-cdfd49cf7d5e admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:47.285370 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-b93bd994-c3d9-4f5d-be77-cdfd49cf7d5e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 10 20:20:47.285763 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 21/43] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:47.483826 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-6050ca06-85c9-408e-821f-94cf31ac428d admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:47.489219 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.wsgi [None req-6050ca06-85c9-408e-821f-94cf31ac428d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-6050ca06-85c9-408e-821f-94cf31ac428d admin admin] Request method failure captured: May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Accept: application/json May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Accept-Encoding: gzip, deflate May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Connection: keep-alive May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Content-Length: 0 May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Host: 10.222.0.61 May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Openstack-Api-Version: compute 2.90 May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Openstack-System-Scope: None May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: User-Agent: python-novaclient May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Auth-Token: gAAAAABieskf6QYg42qckwBJSvrEU28vjasPFKrvlg5CaiREa3DjwYXWycqaDyX08r0a8jYl79mUJBGIAEMGTTsqShjNwwtCG0sTywsRr2DxWZKzqIr7fNopNd_mnaysqns_sgVU2Y3Leb8vXJMbkf6uFZqctOXU69DMt4Uz49BaR3RbmWCRQK8 May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Domain-Id: None May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Domain-Name: None May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Identity-Status: Confirmed May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Is-Admin-Project: True May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Domain-Id: default May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Domain-Name: Default May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Name: admin May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Role: admin,member,reader May 10 20:20:47.490786 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Roles: admin,member,reader May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_92bd0a8a7f7646abb6287b06cfd28dac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant: admin May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant-Name: admin May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User: admin May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Domain-Id: default May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Domain-Name: Default May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Id: caf7948704bc4cd8813f309af89db439 May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Name: admin May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: method: > May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: exception: Flavor 84 could not be found. May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: action_args: {'id': '84'} May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:47.492327 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:47.493450 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:47.494865 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-6050ca06-85c9-408e-821f-94cf31ac428d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:47.496132 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-6050ca06-85c9-408e-821f-94cf31ac428d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060582 May 10 20:20:47.496132 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 23/44] 10.222.0.61 () {60 vars in 1190 bytes} [Tue May 10 20:20:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:20:47.501942 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-2d06b32d-95c8-4b35-8891-b7ece8e352c5 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:47.515316 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-2d06b32d-95c8-4b35-8891-b7ece8e352c5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016912 May 10 20:20:47.516057 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 22/45] 10.222.0.61 () {60 vars in 1210 bytes} [Tue May 10 20:20:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:47.525322 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-502ceea4-91b4-43b9-9b4a-43981de01c6e admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:47.539223 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-502ceea4-91b4-43b9-9b4a-43981de01c6e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017368 May 10 20:20:47.539759 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 24/46] 10.222.0.61 () {60 vars in 1210 bytes} [Tue May 10 20:20:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:47.548944 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-46f6b7b0-cebf-449a-a554-49440b4dde0c admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:47.554078 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-46f6b7b0-cebf-449a-a554-49440b4dde0c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-46f6b7b0-cebf-449a-a554-49440b4dde0c admin admin] Request method failure captured: May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Accept: application/json May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Accept-Encoding: gzip, deflate May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Connection: keep-alive May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Content-Length: 0 May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Host: 10.222.0.61 May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Openstack-Api-Version: compute 2.90 May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Openstack-System-Scope: None May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: User-Agent: python-novaclient May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Auth-Token: gAAAAABieskf6QYg42qckwBJSvrEU28vjasPFKrvlg5CaiREa3DjwYXWycqaDyX08r0a8jYl79mUJBGIAEMGTTsqShjNwwtCG0sTywsRr2DxWZKzqIr7fNopNd_mnaysqns_sgVU2Y3Leb8vXJMbkf6uFZqctOXU69DMt4Uz49BaR3RbmWCRQK8 May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Domain-Id: None May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Domain-Name: None May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Identity-Status: Confirmed May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Is-Admin-Project: True May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Domain-Id: default May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Domain-Name: Default May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Name: admin May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Role: admin,member,reader May 10 20:20:47.555566 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Roles: admin,member,reader May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_92bd0a8a7f7646abb6287b06cfd28dac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant: admin May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant-Name: admin May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User: admin May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Domain-Id: default May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Domain-Name: Default May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Id: caf7948704bc4cd8813f309af89db439 May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Name: admin May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: method: > May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: exception: Flavor 84 could not be found. May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: action_args: {'id': '84'} May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:47.557071 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:47.558018 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:47.559105 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-46f6b7b0-cebf-449a-a554-49440b4dde0c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:47.560249 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-46f6b7b0-cebf-449a-a554-49440b4dde0c admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011355 May 10 20:20:47.560249 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 23/47] 10.222.0.61 () {60 vars in 1190 bytes} [Tue May 10 20:20:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 10 20:20:48.442322 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-502ceea4-91b4-43b9-9b4a-43981de01c6e admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:48.443316 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-502ceea4-91b4-43b9-9b4a-43981de01c6e admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 10 20:20:48.443714 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 25/48] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:48.629732 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-297251e5-4f40-4582-a8b9-29d3ca7d2c0d admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:48.635284 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.wsgi [None req-297251e5-4f40-4582-a8b9-29d3ca7d2c0d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-297251e5-4f40-4582-a8b9-29d3ca7d2c0d admin admin] Request method failure captured: May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Accept: application/json May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Accept-Encoding: gzip, deflate May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Connection: keep-alive May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Content-Length: 0 May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Host: 10.222.0.61 May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Openstack-Api-Version: compute 2.90 May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Openstack-System-Scope: None May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: User-Agent: python-novaclient May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Auth-Token: gAAAAABieskg6BLJuCtU65LyadFaPOVzp93LVPWZTiLsI6grUz8y8G3Tf174YH_Vw0H530DwxdqPoLgxTFZe77uKEGReVMU_LEGbfkPd2AAwm_4LAAyrmZZYrpUq7hCWZpvDdTMsyGM5_V9RvfBgL0aPehQ5rPQAVDB1Gv3is-eDWqmoZW1eiEk May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Domain-Id: None May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Domain-Name: None May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Identity-Status: Confirmed May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Is-Admin-Project: True May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Domain-Id: default May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Domain-Name: Default May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Project-Name: admin May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Role: admin,member,reader May 10 20:20:48.636791 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Roles: admin,member,reader May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_92bd0a8a7f7646abb6287b06cfd28dac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant: admin May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-Tenant-Name: admin May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User: admin May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Domain-Id: default May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Domain-Name: Default May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Id: caf7948704bc4cd8813f309af89db439 May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: X-User-Name: admin May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: method: > May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: exception: Flavor 451 could not be found. May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: action_args: {'id': '451'} May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:48.638832 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:48.639638 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: ERROR nova.api.openstack.wsgi May 10 20:20:48.640764 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-297251e5-4f40-4582-a8b9-29d3ca7d2c0d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:48.641857 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-297251e5-4f40-4582-a8b9-29d3ca7d2c0d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058466 May 10 20:20:48.641857 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 24/49] 10.222.0.61 () {60 vars in 1193 bytes} [Tue May 10 20:20:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:20:48.648391 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-e3010901-11a1-4520-9e1a-5bd07f160845 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:48.662719 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-e3010901-11a1-4520-9e1a-5bd07f160845 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017937 May 10 20:20:48.663167 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 26/50] 10.222.0.61 () {60 vars in 1210 bytes} [Tue May 10 20:20:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:48.672156 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:48.685451 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016685 May 10 20:20:48.685982 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 25/51] 10.222.0.61 () {60 vars in 1210 bytes} [Tue May 10 20:20:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:20:48.694928 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-ea21da0e-650b-4ba5-b99d-d3803961b75e admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:48.700140 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.wsgi [None req-ea21da0e-650b-4ba5-b99d-d3803961b75e admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-ea21da0e-650b-4ba5-b99d-d3803961b75e admin admin] Request method failure captured: May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Accept: application/json May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Accept-Encoding: gzip, deflate May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Connection: keep-alive May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Content-Length: 0 May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Host: 10.222.0.61 May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Openstack-Api-Version: compute 2.90 May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Openstack-System-Scope: None May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: User-Agent: python-novaclient May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Auth-Token: gAAAAABieskg6BLJuCtU65LyadFaPOVzp93LVPWZTiLsI6grUz8y8G3Tf174YH_Vw0H530DwxdqPoLgxTFZe77uKEGReVMU_LEGbfkPd2AAwm_4LAAyrmZZYrpUq7hCWZpvDdTMsyGM5_V9RvfBgL0aPehQ5rPQAVDB1Gv3is-eDWqmoZW1eiEk May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Domain-Id: None May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Domain-Name: None May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Identity-Status: Confirmed May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Is-Admin-Project: True May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Openstack-Nova-Api-Version: 2.90 May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Domain-Id: default May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Domain-Name: Default May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Project-Name: admin May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Role: admin,member,reader May 10 20:20:48.702142 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Roles: admin,member,reader May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_92bd0a8a7f7646abb6287b06cfd28dac", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/92bd0a8a7f7646abb6287b06cfd28dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant: admin May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant-Id: 92bd0a8a7f7646abb6287b06cfd28dac May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-Tenant-Name: admin May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User: admin May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Domain-Id: default May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Domain-Name: Default May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Id: caf7948704bc4cd8813f309af89db439 May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: X-User-Name: admin May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: method: > May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: exception: Flavor 451 could not be found. May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: action_args: {'id': '451'} May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:20:48.703711 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:48.705164 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: ERROR nova.api.openstack.wsgi May 10 20:20:48.706479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-ea21da0e-650b-4ba5-b99d-d3803961b75e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:20:48.707701 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-ea21da0e-650b-4ba5-b99d-d3803961b75e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012057 May 10 20:20:48.707701 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 27/52] 10.222.0.61 () {60 vars in 1193 bytes} [Tue May 10 20:20:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 20:20:49.584555 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:49.585584 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 10 20:20:49.585981 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 26/53] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:49.772805 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-f1cf54c6-5333-4823-adbd-4beda1809eff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:49.789718 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-f1cf54c6-5333-4823-adbd-4beda1809eff admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.066831 May 10 20:20:49.790275 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 28/54] 10.222.0.61 () {64 vars in 1235 bytes} [Tue May 10 20:20:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:50.672449 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:50.673536 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 10 20:20:50.673943 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 27/55] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:50.859072 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-99c20dcf-a323-498f-ae93-7dba9f79c877 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:50.876057 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-99c20dcf-a323-498f-ae93-7dba9f79c877 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067646 May 10 20:20:50.876585 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 29/56] 10.222.0.61 () {64 vars in 1235 bytes} [Tue May 10 20:20:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:51.769409 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:51.770657 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001680 May 10 20:20:51.771047 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 28/57] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:51.955028 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-b44cff93-36c8-4958-879f-465978d00a02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:51.971344 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-b44cff93-36c8-4958-879f-465978d00a02 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.066096 May 10 20:20:51.971885 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 30/58] 10.222.0.61 () {64 vars in 1235 bytes} [Tue May 10 20:20:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:52.856772 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:52.857793 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 10 20:20:52.858196 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 29/59] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:53.043356 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-942848ca-d086-4c9c-9536-8dfc6e340e3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:20:53.062561 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-942848ca-d086-4c9c-9536-8dfc6e340e3f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069580 May 10 20:20:53.063099 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 31/60] 10.222.0.61 () {64 vars in 1235 bytes} [Tue May 10 20:20:52 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:20:53.958661 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:53.959664 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 10 20:20:53.960061 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 30/61] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:20:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:20:54.144988 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-c2199a17-42c4-42ec-bd01-41c7f53974a5 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:20:54.163491 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-c2199a17-42c4-42ec-bd01-41c7f53974a5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068820 May 10 20:20:54.164011 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 32/62] 10.222.0.61 () {60 vars in 1202 bytes} [Tue May 10 20:20:54 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:56.723802 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:56.724813 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-e90a9cc6-dacb-4ce5-baf1-df34ac42de6f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 10 20:21:56.725253 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 31/63] 10.222.0.61 () {54 vars in 930 bytes} [Tue May 10 20:21:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:21:56.782182 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-f9cbd837-57c0-4cd5-bb74-aa747c6a6e57 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:56.801862 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-f9cbd837-57c0-4cd5-bb74-aa747c6a6e57 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070698 May 10 20:21:56.802387 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 33/64] 10.222.0.61 () {60 vars in 1291 bytes} [Tue May 10 20:21:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:21:56.823986 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-60ee189c-0926-4f73-8727-fba4edf7233e admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:56.831484 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-60ee189c-0926-4f73-8727-fba4edf7233e admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011763 May 10 20:21:56.831995 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 32/65] 10.222.0.61 () {60 vars in 1282 bytes} [Tue May 10 20:21:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:21:56.842895 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-ba9c64bd-bd20-4bad-8f07-281df568785a admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:56.850370 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-ba9c64bd-bd20-4bad-8f07-281df568785a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011353 May 10 20:21:56.850890 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 34/66] 10.222.0.61 () {60 vars in 1285 bytes} [Tue May 10 20:21:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:56.862602 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:56.870136 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011086 May 10 20:21:56.870652 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 33/67] 10.222.0.61 () {60 vars in 1285 bytes} [Tue May 10 20:21:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:21:56.881479 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-319707fb-bb58-4c37-b4d4-d9e5aab207a1 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:21:56.888822 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-319707fb-bb58-4c37-b4d4-d9e5aab207a1 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010799 May 10 20:21:56.889369 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 35/68] 10.222.0.61 () {60 vars in 1282 bytes} [Tue May 10 20:21:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:25:14.320306 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:14.321364 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 10 20:25:14.321770 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 34/69] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:25:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:14.595653 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-60928013-281f-461d-b6c1-99ddc0ff53d7 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:14.596826 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:25:14.596826 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 10 20:25:14.598051 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60928013-281f-461d-b6c1-99ddc0ff53d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:14.598484 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60928013-281f-461d-b6c1-99ddc0ff53d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:14.599258 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60928013-281f-461d-b6c1-99ddc0ff53d7 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:14.599677 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-60928013-281f-461d-b6c1-99ddc0ff53d7 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:14.633288 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-60928013-281f-461d-b6c1-99ddc0ff53d7 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.150717 May 10 20:25:14.633832 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 36/70] 10.222.0.61 () {60 vars in 1193 bytes} [Tue May 10 20:25:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:25:15.520881 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:15.521900 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 10 20:25:15.522296 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 35/71] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:15.709986 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-2cb86bbb-2112-4e2f-a384-8da32ca7fc95 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:15.711167 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:25:15.711167 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 10 20:25:15.712329 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-2cb86bbb-2112-4e2f-a384-8da32ca7fc95 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:15.712759 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-2cb86bbb-2112-4e2f-a384-8da32ca7fc95 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:15.713621 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-2cb86bbb-2112-4e2f-a384-8da32ca7fc95 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:15.714042 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-2cb86bbb-2112-4e2f-a384-8da32ca7fc95 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:15.732374 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-2cb86bbb-2112-4e2f-a384-8da32ca7fc95 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.074127 May 10 20:25:15.732850 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 37/72] 10.222.0.61 () {60 vars in 1193 bytes} [Tue May 10 20:25:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:25:27.057284 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:27.058277 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 10 20:25:27.058709 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 36/73] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:25:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:27.244725 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-d6861b0f-ecd4-4c80-8174-f82fc5692249 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:27.245932 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:25:27.245932 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 10 20:25:27.247099 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-d6861b0f-ecd4-4c80-8174-f82fc5692249 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:27.247536 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-d6861b0f-ecd4-4c80-8174-f82fc5692249 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:27.248311 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-d6861b0f-ecd4-4c80-8174-f82fc5692249 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:27.248731 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-d6861b0f-ecd4-4c80-8174-f82fc5692249 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:27.272941 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-d6861b0f-ecd4-4c80-8174-f82fc5692249 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078094 May 10 20:25:27.273759 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 38/74] 10.222.0.61 () {60 vars in 1193 bytes} [Tue May 10 20:25:27 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:25:28.168500 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: DEBUG nova.api.openstack.wsgi [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] Calling method '>' {{(pid=102737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:28.169528 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: INFO nova.api.openstack.requestlog [None req-202b769b-c82e-4ddd-a5af-a3ea25ad04b8 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 10 20:25:28.169948 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: [pid: 102737|app: 0|req: 37/75] 10.222.0.61 () {56 vars in 1074 bytes} [Tue May 10 20:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:25:28.357368 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG nova.api.openstack.wsgi [None req-46b520a6-2fc6-431f-9fbe-5f0c3bc23896 admin admin] Calling method '>' {{(pid=102736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:25:28.358546 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 20:25:28.358546 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: warnings.warn(msg) May 10 20:25:28.359716 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-46b520a6-2fc6-431f-9fbe-5f0c3bc23896 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:28.360156 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-46b520a6-2fc6-431f-9fbe-5f0c3bc23896 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:28.360939 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-46b520a6-2fc6-431f-9fbe-5f0c3bc23896 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:25:28.361390 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: DEBUG oslo_concurrency.lockutils [None req-46b520a6-2fc6-431f-9fbe-5f0c3bc23896 admin admin] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:25:28.383818 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: INFO nova.api.openstack.requestlog [None req-46b520a6-2fc6-431f-9fbe-5f0c3bc23896 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077221 May 10 20:25:28.384354 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: [pid: 102736|app: 0|req: 39/76] 10.222.0.61 () {60 vars in 1193 bytes} [Tue May 10 20:25:28 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:26:26.598258 dv-cinder-828806-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 20:26:26.598802 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: Tue May 10 20:26:26 2022 - graceful shutdown triggered... May 10 20:26:26.599269 dv-cinder-828806-2-iscsi devstack@n-api.service[102737]: Gracefully killing worker 2 (pid: 102737)... May 10 20:26:26.599697 dv-cinder-828806-2-iscsi devstack@n-api.service[102736]: Gracefully killing worker 1 (pid: 102736)... May 10 20:26:27.599927 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: worker 1 buried after 1 seconds May 10 20:26:27.600354 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: worker 2 buried after 1 seconds May 10 20:26:27.600354 dv-cinder-828806-2-iscsi devstack@n-api.service[102735]: goodbye to uWSGI. May 10 20:26:27.601486 dv-cinder-828806-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 20:26:27.602034 dv-cinder-828806-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 20:26:27.604749 dv-cinder-828806-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 20:26:27.617163 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 20:26:27 2022] *** May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: nodename: dv-cinder-828806-2-iscsi May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: machine: x86_64 May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: clock source: unix May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: pcre jit disabled May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: detected number of CPU cores: 4 May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: current working directory: / May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: detected binary path: /usr/bin/uwsgi-core May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: your processes number limit is 47680 May 10 20:26:27.630500 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: your memory page size is 4096 bytes May 10 20:26:27.631376 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: detected max file descriptor number: 2048 May 10 20:26:27.631376 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: lock engine: pthread robust mutexes May 10 20:26:27.631376 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: thunder lock: enabled May 10 20:26:27.631376 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 20:26:27.631376 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 20:26:27.678414 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: Python main interpreter initialized at 0x55bdb618b9c0 May 10 20:26:27.678414 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: python threads support enabled May 10 20:26:27.678414 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: your server socket listen backlog is limited to 100 connections May 10 20:26:27.678414 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: your mercy for graceful operations on workers is 90 seconds May 10 20:26:27.678878 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: mapped 403077 bytes (393 KB) for 2 cores May 10 20:26:27.678878 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: *** Operational MODE: preforking *** May 10 20:26:27.679110 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: *** uWSGI is running in multiple interpreter mode *** May 10 20:26:27.679110 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: spawned uWSGI master process (pid: 117245) May 10 20:26:27.679316 dv-cinder-828806-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 20:26:27.679889 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: spawned uWSGI worker 1 (pid: 117260, cores: 1) May 10 20:26:27.680987 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: spawned uWSGI worker 2 (pid: 117261, cores: 1) May 10 20:26:27.693022 dv-cinder-828806-2-iscsi devstack@n-api.service[117245]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 20:26:28.895954 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:26:28.902069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 20:26:29.718663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:26:29.718663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: from cryptography.utils import int_from_bytes May 10 20:26:29.719409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:26:29.719409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: from cryptography.utils import int_from_bytes May 10 20:26:29.744674 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:26:29.744674 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: from cryptography.utils import int_from_bytes May 10 20:26:29.744938 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:26:29.744938 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: from cryptography.utils import int_from_bytes May 10 20:26:32.175234 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:26:32.175880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:26:32.176149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:26:32.176424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:26:32.176672 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:26:32.177084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.177421 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.177806 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.178073 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.178412 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.178730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.179059 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.179389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.179730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.180000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.180853 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.181247 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-2-iscsi {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.181579 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.181905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.182216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.182544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.182855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.183185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.183502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.184011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.185435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.185435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.185435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.185833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.186067 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.186388 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.186712 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.187034 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.187371 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.187695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.188090 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-2-iscsi {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.188422 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.188615 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:26:32.189214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.189436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:26:32.189690 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.189908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:26:32.190150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.190393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:26:32.190628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.190858 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:26:32.191085 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.191295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.191493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.191676 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.191871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.192024 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.192213 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.192376 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.192532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.192679 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.192854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.193066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.193228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.193390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.193537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.193683 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.193836 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.193989 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.194150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.194412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.194572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.194730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.194877 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.195047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828806-2-iscsi {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.195206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.195362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.195516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.195516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.195795 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.196008 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.196670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.196827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.197124 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.197124 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.197438 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.197594 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.197785 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.197785 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.199438 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.199603 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.199763 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.199945 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.200098 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.200251 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.200402 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.200560 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.200715 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.200880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.201091 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.201245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.201399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.201563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.201722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.201876 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.202030 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.202184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.202337 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.202484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.203210 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.203379 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.203530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.203707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.203707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.204012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828806-2-iscsi {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.204168 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.204327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.204510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.204662 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.204815 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.205008 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.205175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.205335 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.205490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.205646 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.205799 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.205961 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.206116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.206264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.206410 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.206557 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.206719 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.206866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.207019 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.207183 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.207348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.207503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.207673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.207829 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.207983 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.208130 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.208276 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.208428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.208589 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.209442 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.209612 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.209770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.209931 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.210087 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.210614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.210765 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.210925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.211081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.211081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.211370 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.211525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.211679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.211833 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.211981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.212127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.212295 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.212295 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.212592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.212592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.212893 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.213086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.213250 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.213406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.213563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.213718 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.213866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.214039 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.214194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.214340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.214492 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.214647 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.214800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.214956 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.215103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.215257 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.215410 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.215564 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.215717 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.215874 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.216038 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.216186 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.216339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.216486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.216646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.216794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.216947 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.217152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.217309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.217457 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.217615 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.217769 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.217931 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.218102 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.218257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.218412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.218558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.218713 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.219579 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.219752 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.219913 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.220069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.220216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.220363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.220516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.220674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.220844 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.221031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.221193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.221351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.221498 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.221655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.221801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.221954 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.222108 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.222108 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.222409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.222556 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.222713 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.222860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.223901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.224188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.224344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.227119 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.227319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.227486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.227651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.227813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.227813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.228102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.228249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.228395 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.228687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.228857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.229718 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.229896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.230056 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.230225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.230384 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.230532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.230687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.230847 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.230996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.231154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.231317 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.231472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.231620 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.231803 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.231951 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.232097 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.232276 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.232424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.232579 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.232725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.232880 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.233067 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.233221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.233375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.233536 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.233691 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.233839 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.233997 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.234155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.234309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.234469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.234624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.234780 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.234946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.236049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.236049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.236360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.236521 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.236677 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.236824 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.237030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.237199 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.237365 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.237513 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.237660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.237815 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.237969 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.238132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.238288 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.238446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.238602 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.238749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.238906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.239064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.239917 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.240086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.240243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.240401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.240548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.240706 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.240854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.241032 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.241192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.241341 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.241495 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.241657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.241816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.241971 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.242117 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.242270 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.242440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.242588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.242588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.243389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.243547 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.243694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.243840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.243994 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.244150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:26:32.244318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.244475 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.244622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.244769 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.244925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.244925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.245259 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.245420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.245577 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.245724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.245881 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.246031 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.246178 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.246338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.246493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.246651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.246813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.246960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.247107 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.247261 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.247408 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.247555 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.247711 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.247858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.248004 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.248004 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.248301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.248301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.248639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.248803 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.248962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.249133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.249292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.250150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.250316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.250465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.250613 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.250760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.250926 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.251088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.251236 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.251383 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.251530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.251684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.251841 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.252003 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.252151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.252305 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.252460 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.252614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.252777 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.252944 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.253116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.253275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.253429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.253577 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.253734 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.253889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.254037 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.254184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.254340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.254486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.255202 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.255369 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.255531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.255679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.255826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.255975 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.256139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.256294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.256442 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.256596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.256751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.256908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.257082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.257242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.257409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.257557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.257703 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.257859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.258014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.258162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.258309 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.259106 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.259255 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.259482 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.260301 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.260458 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.260614 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.260774 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.260929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.261196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.261348 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.261502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.261650 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.261796 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.261957 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.262105 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.262253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.262554 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.262700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.262872 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.263027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.263174 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.263321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.263467 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.263614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.263771 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.263918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.264065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.264211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.264369 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.264524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.264685 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.264851 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.264851 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.265279 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.265432 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.265599 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.265747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.265894 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.266040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.266187 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.266343 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.266506 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.266654 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.266800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.266958 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.267118 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.267264 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.267426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.267426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.267706 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.267861 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.268016 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.268171 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.268341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.268489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.268637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.268794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.268955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.269138 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.269294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.269441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.269596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.270174 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.270515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.270683 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.270833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.270979 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.271127 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.271276 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.271429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.271587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.271739 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.271889 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.272043 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.272192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.272340 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.272502 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.272642 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.272784 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.272925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.273082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.273507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.273677 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.273834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.274012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.274161 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.274315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.274477 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.274625 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.274780 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.274928 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.275082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.275230 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.275482 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.275641 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.275811 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.275968 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.276123 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.276344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.276523 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.276674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.276828 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.277041 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.277041 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.277341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.277508 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.277657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.277822 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.277972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.278126 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.278282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.278437 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.278583 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.278730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.278876 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.279031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.279195 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.279350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.279512 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.279667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.279825 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.280375 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.280730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.280893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.281074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.281228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.281382 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.281530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.281691 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.281847 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.281995 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.282150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.282298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.282470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.282618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.282766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.282912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.283067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.283225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.283391 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.283557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.283714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.283861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284016 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284163 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284322 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284492 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284492 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284780 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.284927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.285256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.285413 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.285413 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.285792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.285940 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.285940 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.286244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.286392 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.286392 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.286692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.286839 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.286839 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.287134 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.287281 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.287436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.287590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.287747 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.287912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.288075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.288230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.288230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.288522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.288679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.288838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.289010 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.289163 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.289310 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.289467 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.289656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.289814 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.289961 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.290507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.290856 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.291040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.291278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.291436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.291594 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.291749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.291897 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.292062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.292221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.292377 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.292524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.292672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.292827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.292993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.293176 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.293325 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.293479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.293635 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.293783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.293938 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.294100 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.294256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.294411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.294569 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.294718 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.294877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.295032 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.295190 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.295338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.295492 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.295659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.295888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.296048 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.296204 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.296352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.296507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.296654 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.296815 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.296965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.297160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.297318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.297475 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.297622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.297622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.297914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.297914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.298201 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.298348 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.298511 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.298511 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.298800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.298949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.299117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.299263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.299421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.299577 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.299744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.299908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.300143 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.300707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.300873 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.301281 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.301436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.301436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.301740 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.301740 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.302061 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.302210 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.302365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.302530 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.302697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.302860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.303023 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.303185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.303340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.303502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.303665 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.303820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.303996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.304158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.304314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.304478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.304633 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.304794 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.304957 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.305655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.305655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.306059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.306220 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.306391 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.306547 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.306713 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.306886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.307042 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.307204 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.307359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.307513 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.307667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.307829 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.307992 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.308154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.308316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.308470 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.308470 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.308794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.308949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.309132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.309297 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.309461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.309625 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.309787 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.309941 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.310096 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.310256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.310429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.310985 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.311162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.311515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.311686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.311849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.312029 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.312198 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.312369 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.312524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.312679 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.312845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.313078 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.313248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.313405 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.313570 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.313738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.313738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.314046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.314046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.314365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.314520 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.314675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.314830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.314830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.315141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.315303 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.315468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.315630 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.315794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.315964 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.316204 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.316364 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.316528 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.316697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.316697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.317082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.317241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.317404 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.317566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.317734 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.317908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.318076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.318230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.318392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.318568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.318723 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.318878 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.319047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.319213 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.319382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.319538 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.319701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.319871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.320036 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.320192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.322131 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.322298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.322463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.322649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.322810 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.322964 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.323120 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.323275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.323453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.323617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.323773 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.323928 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.324285 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.324447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.324690 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.324857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.325116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.325288 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.325452 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.325606 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.325771 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.325946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.326103 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.326366 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.326528 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.326682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.326848 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.327012 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.327167 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.327321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.327483 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.327650 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.327824 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.328012 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.328190 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.328356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.328521 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.328728 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.328728 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.329050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.329212 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.329378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.329535 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.329704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.329860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.330014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.330183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.330346 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.330509 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.330675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.331116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.331281 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.331437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.331966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.332149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.332314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.332478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.332635 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.332790 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.332966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.333226 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.333393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.333551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.333939 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.334111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.334295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.334540 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.334701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.334857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.335179 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.335343 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.335499 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.335682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.335856 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.336020 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.336175 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.336499 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.336675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.336833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.337016 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.337177 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.337341 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.337508 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.337678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.337842 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.338010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.338173 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.338329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.338490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.338654 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.338810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.338972 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.339136 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.339292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.339447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.339611 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.339766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.339932 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.340086 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.340249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.340420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.340576 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.340739 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.340905 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.341350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.341509 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.341680 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.342177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.342348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.342505 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.342679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.342845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.343017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.343173 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.343335 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.343490 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.343652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.343652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.343965 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.344122 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.344276 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.344430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.344675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.344860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.345048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.345210 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.345374 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.345528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.345528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.345846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.345846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.346149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.346313 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.346487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.346720 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.346889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.347067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.347223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.347378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.347533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.347687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.347854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.348010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.348164 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.348326 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.348489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.348693 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.348868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.349070 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.349232 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.349396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.349552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.349716 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.349871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.350025 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.350179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.350334 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.350495 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.350661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.350817 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.350978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.351163 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.351507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.351673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.351840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.352841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.353064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.353239 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.353396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.353559 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.353725 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.353888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.354051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.354206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.354206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.354527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.354527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.354905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.354905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.355209 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.355362 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.355532 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.355688 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.355850 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.356011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.356166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.356320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.356495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.356660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.356908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.356908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.357233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.357399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.357574 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.357738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.357891 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.358045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.358206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.358409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.358581 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.358738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.358891 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.359097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.359259 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.359424 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.359578 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.359733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.359890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.360053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.360216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.360382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.360545 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.360721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.360884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.361191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.361352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.361746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.361911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.362094 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.362319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.362492 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.362676 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.363078 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.363248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.363412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.363580 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.363736 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.363906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.364069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.364224 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.364378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.364539 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.364694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.364858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.365127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.365298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.365454 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.365609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.365786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.365950 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.366176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.366176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.366489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.366489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.366888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.367115 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.367288 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.367453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.367608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.368314 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.368497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.368660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.368815 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.368995 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.369175 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.369331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.369495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.369659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.369814 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.369983 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.370152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.370309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.370463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.370637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.370637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.370939 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.370939 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.371742 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.371742 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.372066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.372243 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.372487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.372648 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.372812 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.373137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.373402 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.373565 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.373729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.373885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.374040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.374195 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.374364 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.374521 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.374684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.374840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.374995 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.375230 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.375411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.375411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.375719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.375873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.376037 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.376192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.376360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.376516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.376695 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.376863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.377056 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.377306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.377477 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.377642 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.377807 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.377970 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.378134 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.378304 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.378469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.378625 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.378781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.378945 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.379117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.379285 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.379451 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.379617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.379781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.379943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.380106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.380282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.380446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.380601 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.380755 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.380909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.381126 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.381292 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.381447 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.381610 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.381984 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.382149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.382316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.382490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.382726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.382895 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.382895 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.383309 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.383585 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.383756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.383913 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.384068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.384233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.384388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.384553 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.384719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.384881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.385057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.385234 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.385472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.385631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.385795 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.385951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.386106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.386260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.386436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.386591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.386745 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.386908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.387072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.387227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.387479 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.387643 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.387800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.387962 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.388125 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.388287 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.388461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.388628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.388791 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.388946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.389253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.389427 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.389583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.389583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.389875 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.390037 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.390193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.390362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.390517 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.390687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.390863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.391025 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.391180 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.391413 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.391570 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.391733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.391733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.392256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.392412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.392577 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.392750 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.392908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.393115 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.393292 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.393530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.393790 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.393964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.394128 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.394292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.394464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.394635 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.394799 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.394962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.395126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.395126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.395464 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.395698 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.395866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.396021 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.396177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.396331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.396503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.396666 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.396830 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.396830 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.397171 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.397328 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.397584 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.397746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.397900 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.398062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.398478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.398644 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.398808 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.399002 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.399165 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.399334 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.399489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.399660 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.399833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.399997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.400160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.400331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.400486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.400656 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.400812 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.401023 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.401196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.401352 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.401506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.401676 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.401839 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.402217 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.402401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.402559 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.402728 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.402895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.403050 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.403205 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.403368 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.403550 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.403807 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.404054 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.404221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.404397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.404560 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.404717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.404882 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.405060 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.405218 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.405373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.405546 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.405719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.405955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.406115 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.406281 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.406445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.406619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.406799 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.406955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.407110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.407273 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.407429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.407600 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.407837 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.408006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.408176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.408331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.408501 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.408656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.408832 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.409048 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.409221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.409375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.409530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.409684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.409684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.409991 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.410147 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.410309 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.410464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.410628 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.410813 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.410977 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.411133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.411295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.411453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.411620 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.411790 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.411952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.411952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.412454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.412625 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.412791 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.412947 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.413142 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.413299 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.413454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.413625 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.413800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.414040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.414286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.414455 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.415127 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.415294 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.415451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.415606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.415772 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.415953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.416185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.416360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.416656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.416818 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.417036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.417209 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.417378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.417378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.417674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.417854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.418096 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.418264 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.418430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.418586 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.418749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.418903 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.419065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.419231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.419401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.419558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.419712 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.419866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.420027 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.420204 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.420368 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.420531 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.420685 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.420848 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.421029 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.421204 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.421370 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.421536 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.421692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.421855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.422010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.422184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.422522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.422697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.422862 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423180 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423509 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423663 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423827 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.423981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.424558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.424732 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.424890 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.425114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.425282 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.425452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.425609 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.425762 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.425918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.426079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.426315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.426489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.426663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.426886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.427057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.427211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.427365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.427533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.427697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.427889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.428070 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.428302 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.428472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.428627 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.428820 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.428820 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.429160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.429330 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.429498 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.429661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.429831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.429993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.430200 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.430886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.431057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.431057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.431351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.431506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.431659 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.431824 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.432031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.432192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.432357 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.432675 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.432838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.433047 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.433221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.433385 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.433540 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.433694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.433848 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.434086 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.434338 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.434507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.434774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.434935 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.435090 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.435257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.435413 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.435567 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.435730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.436539 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.436722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.436898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.437099 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.437256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.437425 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.437589 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.437759 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.437922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.438085 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.438240 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.438482 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.438641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.438811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.438967 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.439129 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.439306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.439462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.439629 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.439798 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.439954 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.440109 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.440262 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.440426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.440596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.440752 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.440906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.441103 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.441259 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.441428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.441597 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.441767 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.441930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.442093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.442256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.442412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.442715 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.442895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.443051 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.443207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.443207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.443520 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.443520 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.443836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.443990 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.444153 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.444336 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.444573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.444734 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.444898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445731 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445824 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445923 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.445923 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446268 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446361 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446519 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446597 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446688 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446688 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446852 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.446937 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447020 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447122 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447212 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447296 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447772 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447856 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.447963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448050 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448317 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448410 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448646 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.448888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449207 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449334 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449698 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449791 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449878 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449963 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.449963 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450398 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450482 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450580 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450843 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.450929 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451214 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451491 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451594 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.451936 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452200 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452383 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452467 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452718 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452807 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.452890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453146 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453231 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453437 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453521 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453607 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.453973 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454232 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454325 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454688 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.454839 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455392 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455631 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455702 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455702 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455850 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.455930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456092 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456250 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456404 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456476 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456546 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456698 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456851 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.456922 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457190 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457263 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457334 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457405 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457476 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457557 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457640 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.457929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458012 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458092 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458165 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458237 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458308 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458379 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458546 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458620 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458703 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.458959 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117261) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.459558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.460627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.461840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.462566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.462566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.462566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.462566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.462566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:26:32.462566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117260) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:26:32.463015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:32.477575 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_db.sqlalchemy.engines [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:32.527519 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.context [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),163eff52-bb1b-4861-a806-bd9b77af6c50(cell1) {{(pid=117261) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:26:32.529867 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:32.531473 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:32.532302 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:32.534269 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:32.545895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.context [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),163eff52-bb1b-4861-a806-bd9b77af6c50(cell1) {{(pid=117260) load_cells /opt/stack/nova/nova/context.py:464}} May 10 20:26:32.546893 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:32.548175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:32.550419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:32.552019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:32.552846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:26:32.554831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:26:32.566863 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_db.sqlalchemy.engines [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:32.568634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_db.sqlalchemy.engines [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:32.708595 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_db.sqlalchemy.engines [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117261) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:32.726338 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_db.sqlalchemy.engines [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117260) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:26:33.031693 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: WARNING keystonemiddleware.auth_token [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:26:33.039359 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: WARNING keystonemiddleware.auth_token [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:26:33.046151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: WARNING keystonemiddleware.auth_token [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:26:33.054012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: WARNING keystonemiddleware.auth_token [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:26:33.395984 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: WARNING keystonemiddleware.auth_token [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:26:33.400331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: WARNING keystonemiddleware.auth_token [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 20:26:33.403619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: WARNING keystonemiddleware.auth_token [None req-dfd4b6a0-9081-4142-8a01-7a6f0b228584 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:26:33.406514 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: WARNING keystonemiddleware.auth_token [None req-5059af69-3d1c-42bd-a56b-52815145f686 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 20:26:33.409018 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdb618b9c0 pid: 117261 (default app) May 10 20:26:33.411840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bdb618b9c0 pid: 117260 (default app) May 10 20:27:13.624780 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2dace57c-8c86-495c-9ffa-aa1c34c0ab48 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Action: 'create', calling method: .version_select at 0x7fb2793f2280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1955856933"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:14.925329 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2dace57c-8c86-495c-9ffa-aa1c34c0ab48 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.124741 May 10 20:27:14.927959 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 1/1] 10.222.0.61 () {60 vars in 1154 bytes} [Tue May 10 20:27:12 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2129 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 20:27:14.940773 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9cad6a35-4ed9-4531-b5d8-c32d52acce9d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb279246280>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:15.035549 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9cad6a35-4ed9-4531-b5d8-c32d52acce9d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d" status: 200 len: 345 microversion: 2.1 time: 0.099641 May 10 20:27:15.037195 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 2/2] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:14 2022] GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:15.837782 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-510272c9-05a2-4212-a4a9-7da85a21ef5e tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Action: 'create', calling method: .version_select at 0x7fb2793f1280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-247215182", "metadata": {"Type": "work"}}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:16.050374 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2b320acd-c5dd-4a8f-8bf3-21e39a65de73 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb279246430>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:16.146511 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2b320acd-c5dd-4a8f-8bf3-21e39a65de73 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d" status: 200 len: 346 microversion: 2.1 time: 0.100560 May 10 20:27:16.149238 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 3/3] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:16 2022] GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:16.162094 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ee323300-0e15-45bf-b37b-f9a7fb703e2d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Action: 'create', calling method: .version_select at 0x7fb279246940>, body: {"snapshot": {"volume_id": "40f709fa-3d76-48cf-92f3-a81e2547190d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-312540037"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:16.775280 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ee323300-0e15-45bf-b37b-f9a7fb703e2d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.618865 May 10 20:27:16.776293 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 4/4] 10.222.0.61 () {60 vars in 1161 bytes} [Tue May 10 20:27:16 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:16.921874 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1263041006", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "networks": [{"uuid": "792b0ab9-e737-4ad6-8401-6fa6cba5e5c3"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:17.180486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] validate_networks() for [('792b0ab9-e737-4ad6-8401-6fa6cba5e5c3', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:27:17.248031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-510272c9-05a2-4212-a4a9-7da85a21ef5e tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.596901 May 10 20:27:17.258028 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 1/5] 10.222.0.61 () {60 vars in 1155 bytes} [Tue May 10 20:27:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2608 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 20:27:17.265484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c25bcab3-2a09-4b0c-9ed9-3e04f9d5e850 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb279247280>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:17.668229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c25bcab3-2a09-4b0c-9ed9-3e04f9d5e850 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e" status: 200 len: 286 microversion: 2.1 time: 0.408200 May 10 20:27:17.669061 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 2/6] 10.222.0.61 () {58 vars in 1250 bytes} [Tue May 10 20:27:17 2022] GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e => generated 286 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:17.674949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c9be8116-e637-4ecd-b5c7-55e1f6c1b281 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb279247310>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:17.786781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c9be8116-e637-4ecd-b5c7-55e1f6c1b281 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 200 len: 352 microversion: 2.1 time: 0.115643 May 10 20:27:17.791995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 3/7] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:17 2022] GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:17.797400 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-35304ede-eda0-4ba8-9cb7-50a1c1d4b085 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb2792479d0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:17.861473 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-35304ede-eda0-4ba8-9cb7-50a1c1d4b085 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.068133 May 10 20:27:17.862477 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 4/8] 10.222.0.61 () {58 vars in 1139 bytes} [Tue May 10 20:27:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:17.873773 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ec47f6d4-df84-4e25-9f08-0bbcc690f333 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb279250700>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:17.937096 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ec47f6d4-df84-4e25-9f08-0bbcc690f333 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e" status: 200 len: 286 microversion: 2.1 time: 0.066423 May 10 20:27:17.938604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 5/9] 10.222.0.61 () {58 vars in 1250 bytes} [Tue May 10 20:27:17 2022] GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:18.406099 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:27:18.407700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:27:18.409227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:27:18.410682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:27:18.411826 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:27:18.448815 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:18.451166 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:18.452378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:18.453030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:18.507121 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Getting quotas for project c86827b1ba384ed9b24e7e6afd65a4d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:27:18.516473 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Getting quotas for user 45ecca878e5d46cabb3471d7ef14c2d0 and project c86827b1ba384ed9b24e7e6afd65a4d5. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:27:18.531098 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:27:18.534660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:27:18.651788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-dd4db8cf-0a93-4203-96f3-603e87a875a6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.874124 May 10 20:27:18.652537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 5/10] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:27:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:27:18.665970 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a95c0940-6614-4434-b503-53f6ec4ca20a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:18.667384 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a95c0940-6614-4434-b503-53f6ec4ca20a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:18.806814 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0ab05fd8-1dcc-4fae-a2a5-8ba8742f139d tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb27894dee0>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:18.923169 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a95c0940-6614-4434-b503-53f6ec4ca20a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:18.951768 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a95c0940-6614-4434-b503-53f6ec4ca20a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1215 microversion: 2.1 time: 0.292424 May 10 20:27:18.961373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 6/11] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:18 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1215 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:18.961747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0ab05fd8-1dcc-4fae-a2a5-8ba8742f139d tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 200 len: 352 microversion: 2.1 time: 0.162803 May 10 20:27:18.961747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 6/12] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:18 2022] GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 352 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:18.976824 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-814d2730-6d03-4c5b-9be3-2f3c0bfcce0e tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb279247790>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:19.059280 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-814d2730-6d03-4c5b-9be3-2f3c0bfcce0e tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e" status: 200 len: 286 microversion: 2.1 time: 0.104997 May 10 20:27:19.059997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 7/13] 10.222.0.61 () {58 vars in 1250 bytes} [Tue May 10 20:27:18 2022] GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:19.972236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-479b01aa-04c3-488e-a2bc-c7c19bc15968 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb278962670>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:19.983790 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-890990af-e27a-4c1e-95c9-b79b0dd15e94 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:19.986969 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-890990af-e27a-4c1e-95c9-b79b0dd15e94 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:20.201300 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-479b01aa-04c3-488e-a2bc-c7c19bc15968 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 200 len: 352 microversion: 2.1 time: 0.233836 May 10 20:27:20.206850 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 7/14] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:19 2022] GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 352 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:20.213233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6ba1d55e-b358-4f3f-aabc-19d776fb8a35 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb27894de50>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:20.281125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6ba1d55e-b358-4f3f-aabc-19d776fb8a35 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e" status: 200 len: 287 microversion: 2.1 time: 0.072894 May 10 20:27:20.281988 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 8/15] 10.222.0.61 () {58 vars in 1250 bytes} [Tue May 10 20:27:20 2022] GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:20.294573 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-eb88aaad-efd2-490d-ac67-fac492d28da1 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb278962700>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:20.502707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-eb88aaad-efd2-490d-ac67-fac492d28da1 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e" status: 202 len: 0 microversion: 2.1 time: 0.213188 May 10 20:27:20.503983 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 9/16] 10.222.0.61 () {58 vars in 1253 bytes} [Tue May 10 20:27:20 2022] DELETE /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:27:20.514202 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-df7eabcd-b5e2-4c22-a580-d59dc5e48b47 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb278962af0>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:20.584602 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-df7eabcd-b5e2-4c22-a580-d59dc5e48b47 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e" status: 200 len: 286 microversion: 2.1 time: 0.075350 May 10 20:27:20.586344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 10/17] 10.222.0.61 () {58 vars in 1250 bytes} [Tue May 10 20:27:20 2022] GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:20.691588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-890990af-e27a-4c1e-95c9-b79b0dd15e94 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:20.700321 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-890990af-e27a-4c1e-95c9-b79b0dd15e94 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1215 microversion: 2.1 time: 0.733093 May 10 20:27:20.703518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 8/18] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:19 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1215 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:21.214588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7b4dbf6b-4d6f-4fe9-af45-f28374312782 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb278962d30>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:21.333582 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7b4dbf6b-4d6f-4fe9-af45-f28374312782 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 200 len: 353 microversion: 2.1 time: 0.123196 May 10 20:27:21.334633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 11/19] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:21 2022] GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:21.349825 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3e84498e-1caf-4d80-a751-32792154d851 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb27921ec10>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:21.449208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3e84498e-1caf-4d80-a751-32792154d851 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 200 len: 353 microversion: 2.1 time: 0.104761 May 10 20:27:21.450486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 9/20] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:21 2022] GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:21.476022 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6c3b5b8b-0114-497e-a420-2b3a0d9a9b59 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb2789623a0>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:21.603461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1b454d3f-a8f9-4b82-a296-760a2793f06b tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb27921e430>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:21.702584 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6c3b5b8b-0114-497e-a420-2b3a0d9a9b59 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 202 len: 0 microversion: 2.1 time: 0.235073 May 10 20:27:21.703420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 12/21] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:27:21 2022] DELETE /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:27:21.712201 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0a2ee709-280a-4e75-8f79-9ca613bc3782 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb27894dd30>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:21.747594 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-1b454d3f-a8f9-4b82-a296-760a2793f06b tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] HTTP exception thrown: Snapshot 77356ce5-26f3-4e69-aa9f-b371c47d300e could not be found. May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1b454d3f-a8f9-4b82-a296-760a2793f06b tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Request method failure captured: May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e HTTP/1.1 May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqg7Et2FmwIDCeJ5X6UoMUsNnWrDaTxcekQWbcFvICggO7rc67WZl_eKRI0t5T3dRlUkeYUgqkkuBw-S_2dqZsnQt1LeXpxxGsuoz0cmKLmqEethgel36cWMIqXYKcQZgH_ZnC81a8yhYyfP8FCxhrpFRDDsGEZRLzp8m6K0SwKggY May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:27:21.753069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0df7bfa294d8474892d9384abea254ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 0dc7c04ac6d94347ac1d4ce87b35737b May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Snapshot 77356ce5-26f3-4e69-aa9f-b371c47d300e could not be found. May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '77356ce5-26f3-4e69-aa9f-b371c47d300e'} May 10 20:27:21.754224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 77356ce5-26f3-4e69-aa9f-b371c47d300e could not be found. (HTTP 404) (Request-ID: req-42bd041e-d1fa-4726-aacd-99907d1afb92) May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:21.754900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:21.755757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 77356ce5-26f3-4e69-aa9f-b371c47d300e could not be found. May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 20:27:21.758132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 77356ce5-26f3-4e69-aa9f-b371c47d300e could not be found. May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 77356ce5-26f3-4e69-aa9f-b371c47d300e could not be found. May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1b454d3f-a8f9-4b82-a296-760a2793f06b tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Returning 404 to user: Snapshot 77356ce5-26f3-4e69-aa9f-b371c47d300e could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1b454d3f-a8f9-4b82-a296-760a2793f06b tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e" status: 404 len: 111 microversion: 2.1 time: 0.160893 May 10 20:27:21.759264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 10/22] 10.222.0.61 () {58 vars in 1250 bytes} [Tue May 10 20:27:21 2022] GET /compute/v2.1/os-snapshots/77356ce5-26f3-4e69-aa9f-b371c47d300e => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:27:21.782169 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:21.784318 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:21.821053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:21.824192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:21.826970 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:21.827449 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:21.907981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0a2ee709-280a-4e75-8f79-9ca613bc3782 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 200 len: 352 microversion: 2.1 time: 0.200947 May 10 20:27:21.919332 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 13/23] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:21 2022] GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 352 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:21.926202 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3b4ac8e9-7e16-410b-8a57-f8faf4bf5409 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb278972280>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:22.130422 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3b4ac8e9-7e16-410b-8a57-f8faf4bf5409 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d" status: 202 len: 0 microversion: 2.1 time: 0.209744 May 10 20:27:22.132276 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 14/24] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:27:21 2022] DELETE /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:27:22.150915 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-89f6ad64-2600-4208-b7b2-f55c01440041 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb27894de50>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:22.223483 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-89f6ad64-2600-4208-b7b2-f55c01440041 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d" status: 200 len: 345 microversion: 2.1 time: 0.080837 May 10 20:27:22.229800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 15/25] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:22 2022] GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:22.603454 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:22.628792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c7b863ca-ebbf-4809-8733-23322806c5a4 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1275 microversion: 2.1 time: 0.868469 May 10 20:27:22.631297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 11/26] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:21 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1275 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:22.924308 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-cf084cdb-1cc8-44bc-b20b-1e38519e7634 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Calling method '.version_select at 0x7fb2789625e0>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:22.991215 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-cf084cdb-1cc8-44bc-b20b-1e38519e7634 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] HTTP exception thrown: Volume b7c354f6-225a-44df-a0d8-ca635294adce could not be found. May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-cf084cdb-1cc8-44bc-b20b-1e38519e7634 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Request method failure captured: May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce HTTP/1.1 May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesqiepk2DpKPQN_8gtyaf2YDSNUER6QqZa4W42uzTDQdjG6tkVy7u3YPi2Jwim-kpBXlppATlxNE7ih0TSCU_zItUMUu2DtKy5fNiCNI4AADChv9QxyoFsihmjbQV01CK21s4SWu144gHEf4DRulZ4C75NUhMo7n0b0xLrKZxEBKa20 May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: e3da83e11e724b20bb63ca22111cfcc9 May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesGetTestJSON-1455811522 May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:27:22.999350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3da83e11e724b20bb63ca22111cfcc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e3da83e11e724b20bb63ca22111cfcc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e3da83e11e724b20bb63ca22111cfcc9", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e3da83e11e724b20bb63ca22111cfcc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesGetTestJSON-1455811522 May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: e3da83e11e724b20bb63ca22111cfcc9 May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesGetTestJSON-1455811522 May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesGetTestJSON-1455811522-project May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 3b0856904b7c41728fe70049141eaf5f May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesGetTestJSON-1455811522-project May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Volume b7c354f6-225a-44df-a0d8-ca635294adce could not be found. May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'b7c354f6-225a-44df-a0d8-ca635294adce'} May 10 20:27:23.000664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b7c354f6-225a-44df-a0d8-ca635294adce could not be found. (HTTP 404) (Request-ID: req-0103382d-b5e7-4f49-a6a8-21b56543906e) May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.001468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:23.002598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b7c354f6-225a-44df-a0d8-ca635294adce could not be found. May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:27:23.003655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b7c354f6-225a-44df-a0d8-ca635294adce could not be found. May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b7c354f6-225a-44df-a0d8-ca635294adce could not be found. May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-cf084cdb-1cc8-44bc-b20b-1e38519e7634 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] Returning 404 to user: Volume b7c354f6-225a-44df-a0d8-ca635294adce could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:27:23.005243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-cf084cdb-1cc8-44bc-b20b-1e38519e7634 tempest-VolumesGetTestJSON-1455811522 tempest-VolumesGetTestJSON-1455811522-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce" status: 404 len: 109 microversion: 2.1 time: 0.081416 May 10 20:27:23.007144 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 16/27] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:22 2022] GET /compute/v2.1/os-volumes/b7c354f6-225a-44df-a0d8-ca635294adce => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:27:23.236882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-663df465-6550-4fa6-a1c5-02ad54b8b22f tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb2791749d0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:23.290171 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-663df465-6550-4fa6-a1c5-02ad54b8b22f tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] HTTP exception thrown: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-663df465-6550-4fa6-a1c5-02ad54b8b22f tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Request method failure captured: May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d HTTP/1.1 May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqg7Et2FmwIDCeJ5X6UoMUsNnWrDaTxcekQWbcFvICggO7rc67WZl_eKRI0t5T3dRlUkeYUgqkkuBw-S_2dqZsnQt1LeXpxxGsuoz0cmKLmqEethgel36cWMIqXYKcQZgH_ZnC81a8yhYyfP8FCxhrpFRDDsGEZRLzp8m6K0SwKggY May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:27:23.292643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0df7bfa294d8474892d9384abea254ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 0dc7c04ac6d94347ac1d4ce87b35737b May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '40f709fa-3d76-48cf-92f3-a81e2547190d'} May 10 20:27:23.293921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. (HTTP 404) (Request-ID: req-5f57491c-5e8d-49c7-aaa5-5fd5b877f666) May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.294680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:23.295821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:27:23.297930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-663df465-6550-4fa6-a1c5-02ad54b8b22f tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Returning 404 to user: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-663df465-6550-4fa6-a1c5-02ad54b8b22f tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d" status: 404 len: 109 microversion: 2.1 time: 0.064492 May 10 20:27:23.300137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 12/28] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:23 2022] GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:27:23.312130 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ee893ef3-51ea-4308-82e6-ae51d1e7d932 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb278972670>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:23.363074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-ee893ef3-51ea-4308-82e6-ae51d1e7d932 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] HTTP exception thrown: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ee893ef3-51ea-4308-82e6-ae51d1e7d932 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Request method failure captured: May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: DELETE /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d HTTP/1.1 May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesqg7Et2FmwIDCeJ5X6UoMUsNnWrDaTxcekQWbcFvICggO7rc67WZl_eKRI0t5T3dRlUkeYUgqkkuBw-S_2dqZsnQt1LeXpxxGsuoz0cmKLmqEethgel36cWMIqXYKcQZgH_ZnC81a8yhYyfP8FCxhrpFRDDsGEZRLzp8m6K0SwKggY May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:27:23.365082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0df7bfa294d8474892d9384abea254ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 0dc7c04ac6d94347ac1d4ce87b35737b May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '40f709fa-3d76-48cf-92f3-a81e2547190d'} May 10 20:27:23.366339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. (HTTP 404) (Request-ID: req-ad784711-23b5-4c6d-9066-7e97f9bb2a52) May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.367074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:27:23.367934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 20:27:23.368792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ee893ef3-51ea-4308-82e6-ae51d1e7d932 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Returning 404 to user: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ee893ef3-51ea-4308-82e6-ae51d1e7d932 tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d" status: 404 len: 109 microversion: 2.1 time: 0.058801 May 10 20:27:23.371242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 17/29] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:27:23 2022] DELETE /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:27:23.385684 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b78f86b8-02fd-4d71-82cf-d00f95080b8d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Calling method '.version_select at 0x7fb279101790>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:23.439472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-b78f86b8-02fd-4d71-82cf-d00f95080b8d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] HTTP exception thrown: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b78f86b8-02fd-4d71-82cf-d00f95080b8d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Request method failure captured: May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d HTTP/1.1 May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqg7Et2FmwIDCeJ5X6UoMUsNnWrDaTxcekQWbcFvICggO7rc67WZl_eKRI0t5T3dRlUkeYUgqkkuBw-S_2dqZsnQt1LeXpxxGsuoz0cmKLmqEethgel36cWMIqXYKcQZgH_ZnC81a8yhYyfP8FCxhrpFRDDsGEZRLzp8m6K0SwKggY May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:27:23.441608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0df7bfa294d8474892d9384abea254ba", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0df7bfa294d8474892d9384abea254ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 0df7bfa294d8474892d9384abea254ba May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-751966802 May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 0dc7c04ac6d94347ac1d4ce87b35737b May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesSnapshotsTestJSON-751966802-project May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '40f709fa-3d76-48cf-92f3-a81e2547190d'} May 10 20:27:23.442697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. (HTTP 404) (Request-ID: req-b94898c7-1c4b-424c-ba3c-4395279630b2) May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.443302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:27:23.444721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:27:23.447117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b78f86b8-02fd-4d71-82cf-d00f95080b8d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] Returning 404 to user: Volume 40f709fa-3d76-48cf-92f3-a81e2547190d could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b78f86b8-02fd-4d71-82cf-d00f95080b8d tempest-VolumesSnapshotsTestJSON-751966802 tempest-VolumesSnapshotsTestJSON-751966802-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d" status: 404 len: 109 microversion: 2.1 time: 0.065149 May 10 20:27:23.449331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 13/30] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:27:23 2022] GET /compute/v2.1/os-volumes/40f709fa-3d76-48cf-92f3-a81e2547190d => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:27:23.648502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:23.649400 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:23.689634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:23.697587 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:23.698437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:23.698881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:24.339603 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:24.360468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7a7e3d59-8741-4729-a933-c9a54b413779 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1273 microversion: 2.1 time: 0.716963 May 10 20:27:24.361085 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 18/31] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:23 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1273 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:25.381333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:25.382997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:25.396675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:25.408907 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:25.410137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:25.410703 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:25.604396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:25.616655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-51a85cf2-23ca-45f0-ab56-4a2cee2d3997 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1273 microversion: 2.1 time: 0.241737 May 10 20:27:25.619892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 14/32] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:25 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1273 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:26.641747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:26.643589 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:26.666710 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:26.667889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:26.670745 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:26.671450 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:27.394430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:27.410173 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-512212af-fc72-46ec-8dcf-2ba7d7eb2de6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1273 microversion: 2.1 time: 0.774645 May 10 20:27:27.413856 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 19/33] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:26 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1273 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:27:28.430379 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:28.431014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:28.455684 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:28.456372 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:28.465282 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:28.466136 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:30.090689 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:30.105700 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5a29c9c9-e578-4017-8da7-26cc94632c8b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 1.674861 May 10 20:27:30.109666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 15/34] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:28 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:30.818678 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-431f53ce-ad6c-4f13-949b-031bce47bde7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'create', calling method: .version_select at 0x7fb273fce820>, body: {"keypair": {"name": "tempest-keypair-1608769025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF0lZP/xKERshT+fsEYjzRhCq9your7etmoskqHSqL0pflDMR9Z3pbAQQtzQLI2Z75eboh/16hUPafg/oc4DrFpaY+xM1C2SCAMsAN1Rzv/FyPqVibkBavTrb5D9YE4jiA=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:30.909518 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-431f53ce-ad6c-4f13-949b-031bce47bde7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for project 638a84064b2244e0b938b063e13cb944. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:27:30.926704 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-431f53ce-ad6c-4f13-949b-031bce47bde7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for user e092796100394b63a7304abae7e25f7d and project 638a84064b2244e0b938b063e13cb944. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:27:31.026351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-431f53ce-ad6c-4f13-949b-031bce47bde7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.105176 May 10 20:27:31.029036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 20/35] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:27:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:31.122424 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:31.123106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:31.138964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:31.140045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:31.140215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:31.140678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:31.875863 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:31.887488 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-811b6342-7b36-41ce-bbb9-04d8736801fd tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 0.766678 May 10 20:27:31.889570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 16/36] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:31 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:32.911397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:32.912105 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:32.926111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:32.932068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:32.935528 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:32.937314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:33.454676 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:33.489704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-05a2f767-8688-42fe-8b49-e3e7ec4a6204 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 0.580278 May 10 20:27:33.506693 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 17/37] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:32 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:33.819902 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c66ff044-80fc-4e31-966e-f8524ae48bea tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'create', calling method: .version_select at 0x7fb273fe63a0>, body: {"keypair": {"name": "tempest-keypair-1089650766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbsB8VysXCGFb81Cwr6lzP/JC1Bwjc9gbHd1j0NBadV1WwoiTznMUcmdmorwjJje3v+rTVPaBhv53X065MKg7L4Z/bUgFL+3eelA4v8etSbRSDnLL/8LLg8YsQSOqsZfw=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:33.855508 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-c66ff044-80fc-4e31-966e-f8524ae48bea tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:27:33.867598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-c66ff044-80fc-4e31-966e-f8524ae48bea tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for user 36c95ddbd4384bb3a63d02698684e29a and project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:27:33.947428 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c66ff044-80fc-4e31-966e-f8524ae48bea tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.480201 May 10 20:27:33.949464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 21/38] 10.222.0.61 () {62 vars in 1199 bytes} [Tue May 10 20:27:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1483 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 20:27:34.511609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:34.515490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:34.543524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:34.544893 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:34.555675 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:34.556995 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:34.575167 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1131899990", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:34.789845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] validate_networks() for [('a39b073b-dc0a-4098-8dbd-0428d76eaadb', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:27:36.278727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:36.297484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2332c392-717f-4e59-9b41-3db9a415b9aa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 1.788853 May 10 20:27:36.298403 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 22/39] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:34 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:37.200136 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-83fc4ffb-b3b3-4867-ac6b-f35a6a911f59 req-5882995e-c88b-4e1c-bf14-d67997d99d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3bfb8b-461f-42a5-b6d6-e91ba9d16461", "tag": "347aa120-e5e6-4c00-837a-5f1f6cd8cd12"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:37.237434 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-83fc4ffb-b3b3-4867-ac6b-f35a6a911f59 req-5882995e-c88b-4e1c-bf14-d67997d99d34 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.241550 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-83fc4ffb-b3b3-4867-ac6b-f35a6a911f59 req-5882995e-c88b-4e1c-bf14-d67997d99d34 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.329389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-83fc4ffb-b3b3-4867-ac6b-f35a6a911f59 req-5882995e-c88b-4e1c-bf14-d67997d99d34 service nova] Creating event network-changed:347aa120-e5e6-4c00-837a-5f1f6cd8cd12 for instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 on hv-cinder-82880 May 10 20:27:37.330020 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-83fc4ffb-b3b3-4867-ac6b-f35a6a911f59 req-5882995e-c88b-4e1c-bf14-d67997d99d34 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117261) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 20:27:37.331136 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53a301d-0c05-4258-8a80-dfcae723e62f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.344989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53a301d-0c05-4258-8a80-dfcae723e62f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.345917 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53a301d-0c05-4258-8a80-dfcae723e62f None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.346373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53a301d-0c05-4258-8a80-dfcae723e62f None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.385355 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.compute.rpcapi [None req-b53a301d-0c05-4258-8a80-dfcae723e62f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 20:27:37.389323 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53a301d-0c05-4258-8a80-dfcae723e62f None None] Releasing lock "compute-rpcapi-router" {{(pid=117261) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 20:27:37.452951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b53a301d-0c05-4258-8a80-dfcae723e62f None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.397786 May 10 20:27:37.453993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 23/40] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:37.459191 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:37.460604 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:37.470083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.470844 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.471853 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.472507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.488079 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:27:37.490243 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:27:37.491929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:27:37.492494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:27:37.493090 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:27:37.528220 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.534862 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.537875 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:37.540150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:37.663854 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:27:37.694947 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for user df3cf8a2f7c54b80aac61d6ca59672b5 and project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:27:37.714781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:27:37.718872 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:27:37.877502 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d0c00c15-d4ed-4ecf-8ba0-53794c9d7e97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.033623 May 10 20:27:37.883528 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 18/41] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:27:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 4036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:27:37.888557 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1780132879", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "836205da-476a-4894-bbf3-e76da5a6bb7f"}], "security_groups": [{"name": "tempest-securitygroup--1638485434"}], "key_name": "tempest-keypair-1608769025", "user_data": "}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:38.752046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:38.776903 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4a1df53f-adca-4ff8-999e-8840ea9388f6 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 1.321378 May 10 20:27:38.778124 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 24/42] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:37 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:38.795616 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-85449542-c4a3-4797-8683-05a747d61486 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:38.795918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-85449542-c4a3-4797-8683-05a747d61486 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:38.972679 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] validate_networks() for [('836205da-476a-4894-bbf3-e76da5a6bb7f', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:27:39.002632 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-85449542-c4a3-4797-8683-05a747d61486 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:39.039899 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-85449542-c4a3-4797-8683-05a747d61486 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1222 microversion: 2.1 time: 0.259544 May 10 20:27:39.048393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 25/43] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:38 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1222 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:39.568260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1717097498", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:39.650560 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] validate_networks() for [('a39b073b-dc0a-4098-8dbd-0428d76eaadb', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:27:40.697032 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:27:40.697626 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:27:40.698051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:27:40.698573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:27:40.699001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:27:40.722542 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.723007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:40.723908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.724391 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:40.775074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for project 638a84064b2244e0b938b063e13cb944. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:27:40.779258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for user e092796100394b63a7304abae7e25f7d and project 638a84064b2244e0b938b063e13cb944. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:27:40.800197 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:27:40.802414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:27:40.899571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-af465161-f3d6-4a29-9909-c896fcd49fd3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.019521 May 10 20:27:40.900583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 19/44] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:27:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 3021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:27:40.905432 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:40.912713 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:40.922843 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.923298 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:40.924242 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.926468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:40.926596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:27:40.927041 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:27:40.928100 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:27:40.929371 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:27:40.930522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:27:40.949487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.960102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:40.961076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:40.961541 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:41.008585 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:27:41.017769 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for user df3cf8a2f7c54b80aac61d6ca59672b5 and project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:27:41.059111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:27:41.064998 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:27:41.154241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7fd7b396-93e8-4661-b227-9f99e132c067 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.595828 May 10 20:27:41.155586 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 26/45] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:27:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:27:41.162657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e3f473ce-048d-4a37-9b91-1c07b6defc4e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:41.163544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e3f473ce-048d-4a37-9b91-1c07b6defc4e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:41.619865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e3f473ce-048d-4a37-9b91-1c07b6defc4e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:41.638067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:41.648629 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e3f473ce-048d-4a37-9b91-1c07b6defc4e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1238 microversion: 2.1 time: 0.477548 May 10 20:27:41.660252 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-02dc325e-62d3-46e2-b60c-6464946f9e29 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 0.758291 May 10 20:27:41.660771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 27/46] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:41 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1238 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:41.662849 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 20/47] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:40 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:41.674763 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0ecb8cfb-55df-41e9-9c9c-57d433e190fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:41.680104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0ecb8cfb-55df-41e9-9c9c-57d433e190fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:41.784232 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0ecb8cfb-55df-41e9-9c9c-57d433e190fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:41.791961 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0ecb8cfb-55df-41e9-9c9c-57d433e190fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1222 microversion: 2.1 time: 0.129906 May 10 20:27:41.792537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 28/48] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:41 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:41.849699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-865163484", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94296225-31bb-4ee2-9855-9dbaeebe459c"}], "security_groups": [{"name": "tempest-securitygroup--1235177749"}], "key_name": "tempest-keypair-1089650766", "user_data": "}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:42.055090 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] validate_networks() for [('94296225-31bb-4ee2-9855-9dbaeebe459c', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:27:42.666324 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:42.667637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:42.687225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:42.687933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:42.692905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:42.695891 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:43.388925 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:27:43.390076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:27:43.390708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:27:43.391265 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:27:43.391831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:27:43.425452 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.426217 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:43.427273 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.427942 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:43.484908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:27:43.489980 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for user 36c95ddbd4384bb3a63d02698684e29a and project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:27:43.513674 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:43.529150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-93f8513a-db78-42a7-8176-fb7370276219 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1242 microversion: 2.1 time: 0.866568 May 10 20:27:43.533129 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 29/49] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:42 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1242 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:27:43.540097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:27:43.543699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:43.544602 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:43.547071 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:27:43.552391 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.553335 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:43.554483 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.555143 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:43.737952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1ed04930-c5a6-4422-944a-7ca17fab3e4c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.892646 May 10 20:27:43.746800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 21/50] 10.222.0.61 () {62 vars in 1187 bytes} [Tue May 10 20:27:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 20:27:43.767708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:43.771576 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:43.798354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.806062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:43.807592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:43.811015 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:44.172040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:44.185593 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-80a4402c-a1f3-4ba4-8708-2a260d958114 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 0.650251 May 10 20:27:44.186077 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:44.196476 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ac3f10a1-76c0-4222-ac0a-1de1c09e9bce tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1274 microversion: 2.1 time: 0.444900 May 10 20:27:44.197021 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 30/51] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:43 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:44.197145 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 22/52] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:43 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1274 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:44.210201 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2ba69fb4-52ec-4a41-b2bf-997cb6ee038e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:44.210864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2ba69fb4-52ec-4a41-b2bf-997cb6ee038e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:44.503617 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2ba69fb4-52ec-4a41-b2bf-997cb6ee038e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:44.511881 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2ba69fb4-52ec-4a41-b2bf-997cb6ee038e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:44.535073 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2ba69fb4-52ec-4a41-b2bf-997cb6ee038e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:44.535073 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2ba69fb4-52ec-4a41-b2bf-997cb6ee038e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1281 microversion: 2.20 time: 0.336040 May 10 20:27:44.538364 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 23/53] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:44 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1281 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:44.552130 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:44.553534 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:44.561004 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:44.577424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:44.578616 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:44.579338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:44.992702 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:45.019852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a5086632-cd2a-4bc3-a959-7ec7cc441499 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1308 microversion: 2.1 time: 0.470150 May 10 20:27:45.035288 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 31/54] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:44 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1308 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:45.216497 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:45.217313 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:45.226872 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:45.228681 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:45.233338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.238294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.239348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.241852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.243514 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.244526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.254394 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.255193 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.471825 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:45.492049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7ae62eb1-217b-4c9e-aa3a-fe106cc60e38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1280 microversion: 2.1 time: 0.281259 May 10 20:27:45.494174 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 24/55] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:45 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1280 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:45.558479 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:45.560886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:45.582401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.584443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.585525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:45.586119 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:45.839966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:45.852114 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:45.853697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:45.857735 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5857a09a-6995-4df2-8cf4-d6380f9c84b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1333 microversion: 2.20 time: 0.307091 May 10 20:27:45.871481 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 25/56] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:45 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1333 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:46.041319 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:46.041945 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:46.055202 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.055694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.070275 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.070743 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.117890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:46.126941 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-26f2c1f6-82a7-4556-abd9-dbce68a85115 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 0.916210 May 10 20:27:46.129858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 32/57] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:45 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:46.350690 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:46.363273 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f9527388-aece-445e-8ef2-ec2d493038dd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1296 microversion: 2.1 time: 0.327334 May 10 20:27:46.363273 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 26/58] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:46 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1296 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:46.495240 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-d4c75fc4-73d7-4ecd-998c-3f43b3801373 req-8fcf4bba-730b-4187-8351-d6f082d5fbe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3bfb8b-461f-42a5-b6d6-e91ba9d16461", "name": "network-vif-plugged", "status": "completed", "tag": "347aa120-e5e6-4c00-837a-5f1f6cd8cd12"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:46.508088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-d4c75fc4-73d7-4ecd-998c-3f43b3801373 req-8fcf4bba-730b-4187-8351-d6f082d5fbe2 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.508775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-d4c75fc4-73d7-4ecd-998c-3f43b3801373 req-8fcf4bba-730b-4187-8351-d6f082d5fbe2 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.513503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:46.515162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:46.521770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-d4c75fc4-73d7-4ecd-998c-3f43b3801373 req-8fcf4bba-730b-4187-8351-d6f082d5fbe2 service nova] Creating event network-vif-plugged:347aa120-e5e6-4c00-837a-5f1f6cd8cd12 for instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 on hv-cinder-82880 May 10 20:27:46.527241 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.527966 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-d4c75fc4-73d7-4ecd-998c-3f43b3801373 req-8fcf4bba-730b-4187-8351-d6f082d5fbe2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168150 May 10 20:27:46.528226 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.528763 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 33/59] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:46.530640 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.533123 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.658290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:46.675691 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b7eb4313-f658-47f1-b866-18331573dc82 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1280 microversion: 2.1 time: 0.168507 May 10 20:27:46.677556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 27/60] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:46 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1280 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:46.879881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:46.881254 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:46.889529 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.890412 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:46.898749 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:46.899531 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.048717 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:47.058633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:47.060255 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:47.061500 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9943e25e-bc04-4411-99bf-9e41589503ec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1339 microversion: 2.20 time: 0.187271 May 10 20:27:47.062154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 34/61] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:46 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1339 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:47.148601 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:47.149251 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:47.156026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.156848 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.157670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.158108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.391819 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:47.393246 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:47.400578 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.403201 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.409533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.411084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.607798 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:47.617467 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6937dcee-2642-4653-81c9-2f0e320ce814 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 0.473815 May 10 20:27:47.619429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 28/62] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:47 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:47.694664 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:47.696045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:47.709979 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.710447 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.711242 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:47.711687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:47.928823 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:47.948683 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ed9b6f35-0283-4212-9535-727434c76c4d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.565265 May 10 20:27:47.952994 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 35/63] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:47 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:48.081786 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:48.082660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:48.087125 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:48.093563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:48.100845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:48.102664 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-389849f7-8160-456b-86db-1867132ac0ac tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.407748 May 10 20:27:48.103429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 29/64] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:47 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:27:48.106213 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:48.108327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:48.226345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:48.241591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:48.246937 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:48.251885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a7b962da-4ed7-4748-a613-c553bcbb4ee3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1339 microversion: 2.20 time: 0.173973 May 10 20:27:48.275169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 36/65] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:48 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1339 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:48.636130 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:48.637073 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:48.651219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:48.651856 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:48.653261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:48.653856 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.037383 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-44034b6b-fde0-427c-b6a7-6da7585ed752 req-2c37b1ef-10be-4b83-b49b-28f1068399c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f69eab-9bdc-4e34-a3ed-e7417bc13c95", "tag": "606fde48-a88c-4e4e-a204-c1d9ee0708f0"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:49.060420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-44034b6b-fde0-427c-b6a7-6da7585ed752 req-2c37b1ef-10be-4b83-b49b-28f1068399c5 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.062477 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-44034b6b-fde0-427c-b6a7-6da7585ed752 req-2c37b1ef-10be-4b83-b49b-28f1068399c5 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.092632 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-44034b6b-fde0-427c-b6a7-6da7585ed752 req-2c37b1ef-10be-4b83-b49b-28f1068399c5 service nova] Creating event network-changed:606fde48-a88c-4e4e-a204-c1d9ee0708f0 for instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 on hv-cinder-82880 May 10 20:27:49.102891 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-44034b6b-fde0-427c-b6a7-6da7585ed752 req-2c37b1ef-10be-4b83-b49b-28f1068399c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.282858 May 10 20:27:49.104633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 37/66] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:49.119933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:49.122081 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:49.141659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.143440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.145436 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.146081 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.157041 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:49.168909 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d78817c4-e924-4d20-91d2-93a91e1c1f6c tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1315 microversion: 2.1 time: 0.536340 May 10 20:27:49.171497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 30/67] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:48 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:49.183282 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:49.185365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:49.201350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.202432 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.205010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.205821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.648849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:49.664605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:49.665405 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bcf105e6-cc82-430e-b5a0-4727e13723da tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.558918 May 10 20:27:49.666897 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 38/68] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:49 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:49.676108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f186ac6e-e9d5-4a2a-a2bc-a27501f0c161 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.501397 May 10 20:27:49.676108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 31/69] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:49 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:49.691436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:49.691815 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:49.699894 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.700808 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.701846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:49.702425 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:49.914687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:49.923875 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:49.926290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:49.928369 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6f5244ac-c42a-4909-9092-50ce3637754d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.251882 May 10 20:27:49.935900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 32/70] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:49 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:50.186352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:50.186976 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:50.197036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.197697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.198493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.198933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.265919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-3a0af155-e3ab-405b-980b-f9537248770c req-d2f25ab9-ebf7-424b-b810-6493be7a3432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7863f3c8-d62c-4cc1-be62-0902625d59fe", "tag": "d8189a32-1a03-4f88-9ea0-92488138491a"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:50.285853 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-3a0af155-e3ab-405b-980b-f9537248770c req-d2f25ab9-ebf7-424b-b810-6493be7a3432 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.286306 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-3a0af155-e3ab-405b-980b-f9537248770c req-d2f25ab9-ebf7-424b-b810-6493be7a3432 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.326790 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-3a0af155-e3ab-405b-980b-f9537248770c req-d2f25ab9-ebf7-424b-b810-6493be7a3432 service nova] Creating event network-changed:d8189a32-1a03-4f88-9ea0-92488138491a for instance 7863f3c8-d62c-4cc1-be62-0902625d59fe on hv-cinder-82880 May 10 20:27:50.327668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-3a0af155-e3ab-405b-980b-f9537248770c req-d2f25ab9-ebf7-424b-b810-6493be7a3432 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 20:27:50.329389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-24f69b92-b6da-4f9e-86f5-23c57b6883e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.329998 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-24f69b92-b6da-4f9e-86f5-23c57b6883e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.340220 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-24f69b92-b6da-4f9e-86f5-23c57b6883e8 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.346879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-24f69b92-b6da-4f9e-86f5-23c57b6883e8 None None] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.364859 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.compute.rpcapi [None req-24f69b92-b6da-4f9e-86f5-23c57b6883e8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 20:27:50.366447 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-24f69b92-b6da-4f9e-86f5-23c57b6883e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117260) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 20:27:50.389535 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-24f69b92-b6da-4f9e-86f5-23c57b6883e8 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123154 May 10 20:27:50.390434 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 33/71] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:27:50.405427 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:50.414230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d9210fef-dc63-4f6e-855b-e5011bfbda04 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1501 microversion: 2.1 time: 0.231554 May 10 20:27:50.427053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 39/72] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:50 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1501 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:50.695572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:50.697053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:50.697870 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:50.700502 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:50.721485 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.724023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.727317 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.729780 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.734198 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.741759 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:50.746152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:50.746956 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:51.244787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:51.266817 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-67f5c97a-bbf2-4605-a62a-664beebfda91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.578221 May 10 20:27:51.277006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 40/73] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:50 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:51.281596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:51.282360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:51.292510 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:51.300766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:51.301132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e86bd6f5-c9ae-4dec-81a2-813036df8d5a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.620007 May 10 20:27:51.301238 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:51.302083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:51.302551 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 34/74] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:50 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:51.305756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:51.529764 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:51.543281 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:51.545446 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:51.547213 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-72e8b96e-d152-4247-b691-9c9a45557428 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.277956 May 10 20:27:51.547954 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 41/75] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:51 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:52.292169 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:52.293296 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:52.302539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.303382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.304682 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.305419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.321253 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:52.322280 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:52.351066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.358731 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.359890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.360464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.561671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:52.569918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-142dd24b-17f4-445b-901c-b7857fa46ae0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.286374 May 10 20:27:52.570507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 35/76] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:52 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:52.585453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-f4eb572d-a189-452f-a38f-1d75a95c6aec req-8b1d4c62-efe2-49e2-8440-57390aa48202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffd77532-d88b-4fc0-8ffd-81bc169e55db", "tag": "06c622a7-be22-49f6-bfdf-2e75a819556e"}, {"name": "network-changed", "server_uuid": "daa24eb7-cd9f-4ca7-bad7-5c275879fecd", "tag": "d8fb0937-0365-4e3b-b493-e0343c1b6efa"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:52.599052 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-f4eb572d-a189-452f-a38f-1d75a95c6aec req-8b1d4c62-efe2-49e2-8440-57390aa48202 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.600328 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-f4eb572d-a189-452f-a38f-1d75a95c6aec req-8b1d4c62-efe2-49e2-8440-57390aa48202 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.616044 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-f4eb572d-a189-452f-a38f-1d75a95c6aec req-8b1d4c62-efe2-49e2-8440-57390aa48202 service nova] Creating event network-changed:06c622a7-be22-49f6-bfdf-2e75a819556e for instance ffd77532-d88b-4fc0-8ffd-81bc169e55db on hv-cinder-82880 May 10 20:27:52.616961 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-f4eb572d-a189-452f-a38f-1d75a95c6aec req-8b1d4c62-efe2-49e2-8440-57390aa48202 service nova] Creating event network-changed:d8fb0937-0365-4e3b-b493-e0343c1b6efa for instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd on hv-cinder-82880 May 10 20:27:52.622787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:52.624708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-f4eb572d-a189-452f-a38f-1d75a95c6aec req-8b1d4c62-efe2-49e2-8440-57390aa48202 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053018 May 10 20:27:52.626572 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 36/77] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:52.631572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9f21afb0-f722-4131-b7bd-76244bb5347e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.316813 May 10 20:27:52.633802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:52.634715 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:52.641256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.641444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 42/78] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:52 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:52.641864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.642679 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:52.643127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:52.797212 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:52.805904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:52.807830 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:52.809100 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ff7574ac-4293-424e-bdac-68a9c003baa6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.181060 May 10 20:27:52.809737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 37/79] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:52 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:53.095087 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c487647c-41f3-4d77-bc51-abe163fdef89 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eede98c6-3e05-4651-ba39-fd545d259a62"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:27:53.096380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c487647c-41f3-4d77-bc51-abe163fdef89 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:53.102427 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c487647c-41f3-4d77-bc51-abe163fdef89 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.103356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c487647c-41f3-4d77-bc51-abe163fdef89 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.104282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c487647c-41f3-4d77-bc51-abe163fdef89 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.104863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c487647c-41f3-4d77-bc51-abe163fdef89 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.597954 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:53.598811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:53.606454 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.607145 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.607988 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.608421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.746140 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:53.753420 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c7bf197e-f025-42c1-90c4-00ec14194e5b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.159235 May 10 20:27:53.754154 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 38/80] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:53 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:53.767476 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:53.768093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:53.774790 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.775255 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.776029 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.776484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.918908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:53.927448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-57ddb894-3e95-455c-9a4c-5581553e568e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.163551 May 10 20:27:53.928131 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 39/81] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:53 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:53.933120 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:53.934166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:53.940841 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.941494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:53.942405 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:53.943067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:54.091594 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:54.101064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:54.102861 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:54.104044 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4c63ec15-5227-434d-b9ef-b663cfa9a28d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.174466 May 10 20:27:54.104736 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 40/82] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:53 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:54.769299 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:54.770016 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:54.776744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:54.777608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:54.778737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:54.779284 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:54.911032 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:54.918471 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b33ac80a-dba9-4efe-ae77-1789501ed5fd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.152987 May 10 20:27:54.919051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 41/83] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:54 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:27:54.945201 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:54.946014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:54.952117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:54.952574 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:54.953388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:54.953831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:55.303522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:55.310987 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-46dcccad-c491-4a41-b4c6-adc117d58ba8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.369534 May 10 20:27:55.316544 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 42/84] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:54 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:55.316866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:55.317858 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:55.323774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:55.324226 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:55.325019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:55.325490 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:55.454766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:55.465996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:55.468630 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:55.470671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b8191c53-cfe9-4976-8ce9-861e493dd3eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.157593 May 10 20:27:55.471645 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 43/85] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:55 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:55.941844 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:55.942453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:55.952412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:55.953112 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:55.954308 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:55.954923 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:56.277258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c487647c-41f3-4d77-bc51-abe163fdef89 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "POST /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.185516 May 10 20:27:56.278935 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 43/86] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:27:53 2022] POST /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461/os-volume_attachments => generated 194 bytes in 3189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:27:56.329651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:56.332274 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:56.341477 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:56.342813 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:56.344041 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:56.344770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:56.395275 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:56.403887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-65073db2-8e87-49d0-a1da-356471815cc7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.466695 May 10 20:27:56.416966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 44/87] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:55 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:27:56.489587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:56.490330 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:56.500184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:56.502316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:56.504387 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:56.504963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:56.954156 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:56.970617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0f7c7064-e522-4407-b434-ffc285d13e9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.646031 May 10 20:27:56.976069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 44/88] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:56 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:57.027806 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:57.060409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:57.062902 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:57.068044 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-95f61d41-4be5-43c9-b3b6-bd8e94ed2aed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.579798 May 10 20:27:57.082800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 45/89] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:56 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:27:57.424377 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:57.425167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:57.431890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:57.432355 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:57.433196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:57.433598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:57.578244 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:57.586217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f9284d7c-a1cf-4a50-801b-8d4ca26f1a7b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.166514 May 10 20:27:57.586907 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 45/90] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:57 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:57.991950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:57.992554 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:57.998403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:57.998850 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:57.999620 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:58.000054 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:58.096121 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:58.097065 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:58.103275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:58.103729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:58.104537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:58.105184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:58.146986 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:58.161438 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b6d9f578-06c0-4d1f-9cab-aef9fa7a0072 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.169294 May 10 20:27:58.161438 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 46/91] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:57 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:58.250158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:58.258883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:58.260389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:58.261552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b8e376cd-c7c3-492b-a9c5-ed31dd08e534 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.171481 May 10 20:27:58.262121 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 46/92] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:58 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:27:58.603929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:58.604532 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:58.610329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:58.610777 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:58.611536 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:58.611967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:58.738028 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:58.745877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e8c434a8-b875-4138-9c8e-990c1bf8f909 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.146300 May 10 20:27:58.746543 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 47/93] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:58 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:59.173248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:59.173867 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:59.180299 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.180814 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.181644 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.182092 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.279653 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:59.280365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:59.286540 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.287069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.287917 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.288424 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.309708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:59.316896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-257be9ca-5c21-4c44-b4a6-df5adfd95e48 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.147423 May 10 20:27:59.317504 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 47/94] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:59 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:27:59.411154 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:59.419323 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:59.420874 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:59.422009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-32556fe0-1bd2-4dd6-8e81-56b10cf0f3f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.146327 May 10 20:27:59.422575 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 48/95] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:27:59 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:27:59.763190 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:27:59.764005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:27:59.770359 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.770819 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.771597 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:27:59.772098 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:27:59.897325 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:27:59.904696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7945cc18-a335-4063-802a-191e988e2d53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.145382 May 10 20:27:59.905298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 48/96] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:27:59 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:00.334026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:00.335138 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:00.341422 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.342040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.342966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.343609 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.443143 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:00.444377 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:00.452609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.453072 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.454016 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.454636 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.516009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:00.525643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cbb364a4-1152-4b05-81ce-3fb74ef05b6d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.195055 May 10 20:28:00.526641 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 49/97] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:00 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:00.539996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-9e178ad3-5222-42e4-a16c-fd9d1c20e7b6 req-74db7297-8620-4aa7-b4aa-e865dc42d51e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f69eab-9bdc-4e34-a3ed-e7417bc13c95", "name": "network-vif-plugged", "status": "completed", "tag": "606fde48-a88c-4e4e-a204-c1d9ee0708f0"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:00.550539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-9e178ad3-5222-42e4-a16c-fd9d1c20e7b6 req-74db7297-8620-4aa7-b4aa-e865dc42d51e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.551060 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-9e178ad3-5222-42e4-a16c-fd9d1c20e7b6 req-74db7297-8620-4aa7-b4aa-e865dc42d51e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.575450 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-9e178ad3-5222-42e4-a16c-fd9d1c20e7b6 req-74db7297-8620-4aa7-b4aa-e865dc42d51e service nova] Creating event network-vif-plugged:606fde48-a88c-4e4e-a204-c1d9ee0708f0 for instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 on hv-cinder-82880 May 10 20:28:00.580916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-9e178ad3-5222-42e4-a16c-fd9d1c20e7b6 req-74db7297-8620-4aa7-b4aa-e865dc42d51e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053103 May 10 20:28:00.582551 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 50/98] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:28:00.621708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:00.630945 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:00.633137 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:00.634185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2cc7be39-2b5b-4e19-b62b-5d0cadb037e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.198228 May 10 20:28:00.635014 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 49/99] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:00 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:00.923640 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:00.924313 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:00.931826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.932274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:00.933188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:00.933978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:01.080668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:01.089775 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-65b5d88c-d9ed-4128-9d46-f5d3a7b9894b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.171756 May 10 20:28:01.090362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 51/100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:00 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:01.542913 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:01.543617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:01.550062 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:01.550519 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:01.551299 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:01.551742 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:01.652417 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:01.652952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:01.660189 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:01.660646 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:01.661460 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:01.662106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:01.691616 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:01.700622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2bd1bbe0-88d9-4cbb-b854-f3900616df6b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.161436 May 10 20:28:01.701206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 50/101] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:01 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:01.793690 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:01.801805 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:01.803931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:01.805088 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-539b9cf6-a2c3-43ff-a070-8c556a0296aa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.156527 May 10 20:28:01.805650 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 52/102] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:01 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:02.107041 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:02.107909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:02.114193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.114750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.118463 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.118919 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.273743 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:02.281194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4c2373d2-7511-43d3-8898-6b2b9bb67b8c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.177757 May 10 20:28:02.281776 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 51/103] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:02 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:02.717635 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:02.718260 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:02.724296 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.724877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.726207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.726666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.823765 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:02.824382 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:02.830912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.831567 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.832356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:02.832801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:02.865304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:02.874260 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7a0f3247-a3e3-4ac9-8553-4e8e58893734 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.159747 May 10 20:28:02.885539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 53/104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:02 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:02.972486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:02.983759 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:02.985775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:02.987183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9832cc95-aaf1-4576-8ba7-82c4adf7f2fa tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.167957 May 10 20:28:02.987763 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 52/105] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:02 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:03.298180 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:03.298795 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:03.305303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:03.305759 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:03.306539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:03.306984 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:03.442346 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:03.450272 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b1f442c9-f2d3-423e-8a1f-21dca92d77af tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.155839 May 10 20:28:03.450831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 54/106] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:03 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:03.891700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:03.892316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:03.898949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:03.899406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:03.900256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:03.900672 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:04.005583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:04.006303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:04.013145 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:04.013727 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:04.014662 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:04.015429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:04.036380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:04.046863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-dad41a9e-f9ad-479e-a5e8-9f67a844f312 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.158924 May 10 20:28:04.047616 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 53/107] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:03 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:04.177892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:04.200827 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:04.203775 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:04.205967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8ba9671b-fe48-4b00-a1b5-7079022f8d01 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.204633 May 10 20:28:04.206610 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 55/108] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:03 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:04.467423 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:04.468363 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:04.474503 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:04.474933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:04.475711 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:04.476150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:04.635925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:04.649457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-beb8ecb4-072e-4ed3-8851-5953ea01bf55 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.185782 May 10 20:28:04.650053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 54/109] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:04 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:05.063404 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:05.063970 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:05.070566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.071021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.071801 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.072257 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.204415 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:05.211717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c72f2a3e-9bda-4e93-937a-75b7360dac46 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.152106 May 10 20:28:05.212276 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 56/110] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:05 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:05.223552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:05.224191 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:05.231312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.231769 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.232583 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.233065 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.363520 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:05.372061 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:05.373586 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:05.374685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9103b80b-cce3-4eba-a78e-fc88b40631c5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.155063 May 10 20:28:05.375241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 55/111] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:05 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:05.666905 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:05.667512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:05.673308 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.673756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.674511 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:05.674945 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:05.801010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:05.809176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4d549d07-eace-4b85-adbc-5f39817dd65b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.146284 May 10 20:28:05.809744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 57/112] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:05 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:06.227515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:06.228124 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:06.234555 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:06.234948 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:06.235709 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:06.236146 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:06.357245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:06.364355 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6e57f01e-8fc9-45b4-8777-f39d273c5ac6 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.140657 May 10 20:28:06.364922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 56/113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:06 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:06.391526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:06.392143 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:06.398426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:06.398873 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:06.399634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:06.400067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:06.529788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:06.538078 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:06.539561 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:06.540644 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-671a08c2-b11c-4efa-af91-7ffba5d91bd5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.153000 May 10 20:28:06.541232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 58/114] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:06 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:06.825585 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:06.826205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:06.832014 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:06.832470 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:06.833278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:06.833726 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:06.957352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:06.965449 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-407e3782-0f52-4f20-8b0a-a8a4fcb5bf4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.143612 May 10 20:28:06.966107 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 57/115] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:06 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:07.382383 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:07.382989 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:07.388790 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.389264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:07.390050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.390480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:07.520431 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:07.529188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9265688a-8205-4400-b188-deeeac23220b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.151323 May 10 20:28:07.529815 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 59/116] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:07 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:07.558196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:07.558848 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:07.565293 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.565754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:07.566531 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.566976 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:07.701663 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:07.710507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:07.712007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:07.713226 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d4db877c-2151-4f6e-af13-47be99cab81f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.158756 May 10 20:28:07.714121 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 58/117] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:07 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:07.983937 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:07.984626 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:07.991276 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.991770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:07.992577 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:07.993065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:08.120918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:08.128079 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f6226520-6e5d-4516-97d8-e3fc8825f8bf tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.148489 May 10 20:28:08.128632 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 60/118] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:07 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:08.546073 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:08.546631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:08.552609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:08.553149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:08.553930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:08.554380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:08.683015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:08.690336 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c3885513-9da1-4de0-81eb-177229c73b36 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.148077 May 10 20:28:08.690898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 59/119] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:08 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:08.735518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:08.736118 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:08.741936 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:08.742382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:08.743136 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:08.743563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:08.867344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:08.875256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:08.876757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:08.877884 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-04615c3f-6ee8-4fad-b734-e29c09076572 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.146229 May 10 20:28:08.878463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 61/120] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:08 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:09.145669 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:09.146283 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:09.152630 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.153116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:09.153886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.154322 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:09.281689 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:09.289818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-13911e4b-e72c-4e9e-a1d1-3e4d67967a7d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.148275 May 10 20:28:09.290390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 60/121] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:09 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:09.706274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:09.706813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:09.713260 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.713706 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:09.714465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.714899 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:09.835584 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:09.842704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1db74c3e-6ff7-4aba-9581-a3b259e555ec tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.140237 May 10 20:28:09.843266 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 62/122] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:09 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:09.896020 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:09.896711 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:09.903848 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.904302 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:09.905111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:09.905551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:10.044308 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:10.052160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:10.053694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:10.054793 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fe66eb87-ffe9-4236-af21-bf84f20f8133 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.162841 May 10 20:28:10.055362 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 61/123] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:09 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:10.306315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:10.306846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:10.312828 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:10.313306 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:10.314107 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:10.314539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:10.438000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:10.446217 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9cbd6026-05c3-44d7-a337-8c868ae4afda tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.143781 May 10 20:28:10.446788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 63/124] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:10 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:10.859621 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:10.860230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:10.866717 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:10.867169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:10.867935 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:10.868405 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:10.996755 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:11.004240 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0fa7451c-d8a5-4490-a665-9922f64194ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.148447 May 10 20:28:11.004820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 62/125] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:10 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:11.071643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:11.072846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:11.079382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:11.080081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:11.080749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:11.084844 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:11.225722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:11.233441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:11.234924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:11.236013 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d6e5c515-0fcf-446f-9217-1486962d172c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.168314 May 10 20:28:11.236882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 64/126] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:11 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:11.446560 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-0d308103-c41b-48f5-bf81-435a0ccc9dbb req-1e3c422e-99d7-4b2d-803a-b4fde6e33c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd77532-d88b-4fc0-8ffd-81bc169e55db", "name": "network-vif-plugged", "status": "completed", "tag": "06c622a7-be22-49f6-bfdf-2e75a819556e"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:11.454686 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0d308103-c41b-48f5-bf81-435a0ccc9dbb req-1e3c422e-99d7-4b2d-803a-b4fde6e33c5a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:11.455142 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0d308103-c41b-48f5-bf81-435a0ccc9dbb req-1e3c422e-99d7-4b2d-803a-b4fde6e33c5a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:11.465270 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:11.466034 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:11.468448 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-0d308103-c41b-48f5-bf81-435a0ccc9dbb req-1e3c422e-99d7-4b2d-803a-b4fde6e33c5a service nova] Creating event network-vif-plugged:06c622a7-be22-49f6-bfdf-2e75a819556e for instance ffd77532-d88b-4fc0-8ffd-81bc169e55db on hv-cinder-82880 May 10 20:28:11.472111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:11.472563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:11.473483 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:11.473590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-0d308103-c41b-48f5-bf81-435a0ccc9dbb req-1e3c422e-99d7-4b2d-803a-b4fde6e33c5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031570 May 10 20:28:11.473862 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:11.474211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 63/127] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:28:11.609013 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:11.617916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a4aa0345-9386-4c5e-950e-2d0e76cdb61f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.159031 May 10 20:28:11.618507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 65/128] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:11 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:12.021611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:12.022321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:12.028794 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.029303 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.030083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.030532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.171006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:12.179911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b47b3811-df25-41a0-8fe6-ed2315c7e300 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.162961 May 10 20:28:12.180486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 64/129] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:12 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:12.253746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:12.254293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:12.260247 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.260699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.261747 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.262110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.383923 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:12.391564 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:12.393095 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:12.394188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fb71adca-8990-402f-b9a5-65af8c1f14f6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.144352 May 10 20:28:12.394744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 66/130] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:12 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:12.634901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:12.635516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:12.641459 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.641916 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.642695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:12.643138 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:12.765285 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:12.773371 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8d6aa500-9e8b-4f40-b93e-270b121ae136 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.142791 May 10 20:28:12.774115 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 65/131] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:12 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:13.200280 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:13.201301 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:13.207933 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.208392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.209209 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.209659 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.414038 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:13.414788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:13.421385 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.421917 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.422779 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.423356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.592244 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:13.595897 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:13.600883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:13.602411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:13.603515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3fb4b8af-4e3a-42bd-9ab4-e2105c1d428e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.194482 May 10 20:28:13.603638 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d9570216-6eab-46f9-8fe7-74ba872fd365 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.407250 May 10 20:28:13.604074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 66/132] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:13 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:13.604421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 67/133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:13 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:13.789822 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:13.790337 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:13.796657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.797149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.797934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:13.798375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:13.926760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:13.934100 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3aaf1942-4f97-45c8-a4c5-fc2f522f9d7c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.148984 May 10 20:28:13.934663 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 67/134] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:13 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:14.619969 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:14.620672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:14.621881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:14.622540 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:14.627120 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.627640 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:14.628497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.629017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:14.630284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.631323 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:14.632206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.633076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:14.866383 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:14.872876 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:14.877344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bc46becd-654a-4c26-8fa7-8162d6c78a09 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.261108 May 10 20:28:14.878214 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 68/135] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:14 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:14.881968 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:14.883567 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:14.884801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5bfbf573-0657-4b51-9960-8d7445067fe8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.266729 May 10 20:28:14.885543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 68/136] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:14 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:14.950350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:14.950987 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:14.956765 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.957256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:14.958023 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:14.958459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:15.086349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:15.093502 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4a7148b6-8db4-4254-8202-441200cc0140 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.146931 May 10 20:28:15.094064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 69/137] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:14 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:15.895321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:15.896180 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:15.903511 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:15.904117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:15.904225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:15.904665 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:15.905468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:15.905909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:15.910086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:15.910555 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:15.911315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:15.911742 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:16.113949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:16.117717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:16.121796 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b1643f38-a8cd-4eca-b6a1-edfd19347faf tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.230594 May 10 20:28:16.122378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 69/138] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:15 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:16.127422 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:16.128230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:16.135034 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:16.135279 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:16.135498 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:16.136295 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:16.136740 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:16.137155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:16.138601 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3333d68d-0403-48d4-b4ed-7eb88a67af97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.239431 May 10 20:28:16.139392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 70/139] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:15 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:16.267307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:16.275310 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b0bd84a3-96a4-4127-b416-cd1b9cafe1f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.151730 May 10 20:28:16.275892 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 70/140] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:16 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:17.145648 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:17.146678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:17.153374 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.153820 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.154694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.155035 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.158183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:17.158914 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:17.165712 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.166171 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.166953 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.167401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.348007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:17.350873 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:17.356512 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:17.358155 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:17.358826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0a37cec4-dd5f-45d0-afd9-b3b26c1bdcce tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.217643 May 10 20:28:17.359265 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e37ce181-73ff-4cf6-a89e-6d41d806ecbc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.205168 May 10 20:28:17.359447 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 71/141] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:17 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:17.361501 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 71/142] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:17 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:17.366135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:17.366957 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:17.373816 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.374265 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.375071 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.375539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.510689 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:17.518244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bc10358a-966f-4d3d-9098-82a451ef5863 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.157759 May 10 20:28:17.518742 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 72/143] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:17 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:17.842014 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-54ad56a2-e32f-416d-bde0-a88a25429e11 req-94b5f9ea-abe7-4b0d-a21a-f9c327380d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa24eb7-cd9f-4ca7-bad7-5c275879fecd", "name": "network-vif-plugged", "status": "completed", "tag": "d8fb0937-0365-4e3b-b493-e0343c1b6efa"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:17.850638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-54ad56a2-e32f-416d-bde0-a88a25429e11 req-94b5f9ea-abe7-4b0d-a21a-f9c327380d83 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:17.851199 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-54ad56a2-e32f-416d-bde0-a88a25429e11 req-94b5f9ea-abe7-4b0d-a21a-f9c327380d83 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:17.863849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-54ad56a2-e32f-416d-bde0-a88a25429e11 req-94b5f9ea-abe7-4b0d-a21a-f9c327380d83 service nova] Creating event network-vif-plugged:d8fb0937-0365-4e3b-b493-e0343c1b6efa for instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd on hv-cinder-82880 May 10 20:28:17.869051 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-54ad56a2-e32f-416d-bde0-a88a25429e11 req-94b5f9ea-abe7-4b0d-a21a-f9c327380d83 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030699 May 10 20:28:17.869883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 72/144] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:28:18.376017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:18.377444 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:18.385212 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:18.385657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:18.386629 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:18.387266 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:18.390029 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:18.390926 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:18.401624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:18.401624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:18.401624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:18.401624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:18.590089 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:18.601093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6e7cbf9e-e46b-4b59-ab04-cd65dc29d09d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.228860 May 10 20:28:18.603151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 73/145] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:18 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:18.608336 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:18.609040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:18.628396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:18.646496 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:18.653044 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:18.654000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:18.654456 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:18.656823 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:18.658365 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:18.660344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7dc6e737-8dfa-4dd3-b7aa-8c4638cf948f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.282560 May 10 20:28:18.660344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 73/146] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:18 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:18.848903 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:18.857595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5bfb4f1b-d377-4be8-a2dc-8a1df3c80bae tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.252809 May 10 20:28:18.858164 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 74/147] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:18 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:19.619802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:19.620419 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:19.626898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.627354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.628142 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.628582 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.677876 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:19.678485 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:19.686791 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.689576 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.690702 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.691340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.832389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:19.852873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d8437079-3404-4238-b354-2d09c9bbba51 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.225972 May 10 20:28:19.853736 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 74/148] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:19 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:19.872953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:19.877762 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:19.880282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:19.886763 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:19.887261 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.887727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.888723 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:19.889382 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:19.891117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:19.892242 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e1c6ef12-b94e-420b-a335-66ebc49590fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.218315 May 10 20:28:19.892812 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 75/149] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:19 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:20.061124 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:20.068537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c299fbf6-3b73-448b-857c-56e865aae4b7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.195158 May 10 20:28:20.069208 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 75/150] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:19 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:20.870052 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:20.870661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:20.876560 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:20.877036 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:20.877804 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:20.878233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:20.910873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:20.911411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:20.918395 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:20.918849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:20.919626 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:20.920066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:21.048624 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:21.056602 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e09fd600-c164-4acf-b6ba-fce776be7b0c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.190992 May 10 20:28:21.057191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 76/151] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:20 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:21.083067 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:21.087389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:21.087999 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:21.091034 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:21.092541 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:21.093678 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-655fecff-29ff-4e51-a5bf-a233451f2a06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.186751 May 10 20:28:21.094173 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:21.094311 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 76/152] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:20 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:21.094893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:21.095859 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:21.096295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:21.222393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:21.230294 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f0c625a7-855f-4e27-b7b5-acd02402005d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.146661 May 10 20:28:21.230875 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 77/153] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:21 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:22.074053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:22.074677 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:22.081118 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.081571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.082485 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.082922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.111594 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:22.112336 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:22.119388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.119834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.120606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.121070 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.267324 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:22.274947 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-95445385-f202-4458-af2c-562bf31b298f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.205380 May 10 20:28:22.275532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 77/154] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:22 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:22.280489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:22.281202 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:22.287819 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:22.288903 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.289639 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.290649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:22.291194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:22.296073 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:22.297625 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:22.298726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-60ecf58b-ffbc-4aae-a7c8-2e51d797971a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.190982 May 10 20:28:22.299292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 78/155] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:22 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:22.424319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:22.432278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f9c4efb2-e39e-440c-a168-dcdf4c4f364c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.155802 May 10 20:28:22.432852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 78/156] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:22 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:23.156123 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:23.156664 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:23.162427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.162875 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.163635 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.164151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.188621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:28:23.297855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:23.299126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:23.311709 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.313013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.316080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.316864 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.398207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-95993adf-af0b-4967-8ea3-2959be0ab09a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 204 len: 0 microversion: 2.1 time: 0.245233 May 10 20:28:23.399871 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 79/157] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:28:23 2022] DELETE /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:28:23.408040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:23.408919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:23.415445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.416131 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.417110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.417774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.542587 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:23.550984 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0b9ee027-297e-41c6-904b-20d4264f90b5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.263065 May 10 20:28:23.560900 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 79/158] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:23 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:23.574711 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:23.575332 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:23.582502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.583208 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.584151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.584744 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.593358 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:23.601543 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:23.603040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:23.604141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fee0285b-9d3b-479b-ac3f-98947580ce83 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.202696 May 10 20:28:23.604701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 80/159] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:23 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:23.619687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:23.620582 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:23.627571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.628124 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.628907 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:23.629371 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:23.782787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:23.791434 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-63436b89-4f5a-4db6-81db-c6e97f728d55 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.229290 May 10 20:28:23.792528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 80/160] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:23 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:23.812539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:23.822275 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e955c617-c4eb-4566-8142-19401c73776b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.204844 May 10 20:28:23.829922 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 81/161] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:23 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:24.567454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:24.568166 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:24.575600 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.576138 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.577212 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.577727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.621865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:24.622484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:24.628405 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.629141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.630103 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.630686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.777153 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:24.785673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ce269b2f-e261-41f3-afc9-e75edfccbb82 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.221858 May 10 20:28:24.795932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 81/162] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:24 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:24.808577 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:24.809229 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:24.810894 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:24.815851 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.816309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.817641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.818241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.821667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:24.823767 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:24.825203 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-089457bb-4c43-4013-83d6-da53b766ff8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.207090 May 10 20:28:24.825866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 82/163] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:24 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:24.838209 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:24.841482 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:24.851588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.852265 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:24.854187 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:24.854798 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.047226 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:25.056214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7899e759-5d2d-447f-8035-b8e91e63cb5d tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.251482 May 10 20:28:25.057099 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 82/164] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:24 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:25.061812 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-43a52a4a-e4a9-4036-a2bc-b1d8e58a83da req-2197b4cc-3be6-483a-a499-b8064951d832 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7863f3c8-d62c-4cc1-be62-0902625d59fe", "name": "network-vif-plugged", "status": "completed", "tag": "d8189a32-1a03-4f88-9ea0-92488138491a"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:25.062495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:25.070904 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-43a52a4a-e4a9-4036-a2bc-b1d8e58a83da req-2197b4cc-3be6-483a-a499-b8064951d832 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:25.071640 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-43a52a4a-e4a9-4036-a2bc-b1d8e58a83da req-2197b4cc-3be6-483a-a499-b8064951d832 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.071748 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-00c4069b-e602-4c09-9708-030aaf15d069 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.237930 May 10 20:28:25.072497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 83/165] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:24 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:25.084673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-43a52a4a-e4a9-4036-a2bc-b1d8e58a83da req-2197b4cc-3be6-483a-a499-b8064951d832 service nova] Creating event network-vif-plugged:d8189a32-1a03-4f88-9ea0-92488138491a for instance 7863f3c8-d62c-4cc1-be62-0902625d59fe on hv-cinder-82880 May 10 20:28:25.089979 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-43a52a4a-e4a9-4036-a2bc-b1d8e58a83da req-2197b4cc-3be6-483a-a499-b8064951d832 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031481 May 10 20:28:25.090663 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 83/166] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:28:25.803207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:25.805120 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:25.811562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:25.812086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.812917 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:25.813382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.844007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:25.844912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:25.851366 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:25.852400 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.853345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:25.853925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:25.989671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:26.000147 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7199d487-26cc-450b-83cf-9c9f5c0fc54e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.198056 May 10 20:28:26.000147 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 84/167] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:25 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:26.025042 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:26.032820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:26.034354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:26.035738 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ccf23d78-3755-43e9-833a-083688223de4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.196513 May 10 20:28:26.036369 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 84/168] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:25 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:26.073902 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:26.075033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:26.080841 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:26.081326 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:26.082097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:26.083021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:26.089789 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:26.090416 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:26.097857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:26.098733 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:26.099523 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:26.099977 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:26.270972 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:26.287601 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-36a353dd-7440-42f1-99ba-7654f9ff337b tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.218151 May 10 20:28:26.288391 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 85/169] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:26 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:26.288957 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:26.299175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-20261cdf-6497-4c2d-89b8-55818430b403 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.215006 May 10 20:28:26.299743 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 85/170] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:26 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:27.014068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:27.014771 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:27.021228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.022066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.023254 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.023993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.054047 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:27.055320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:27.061849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.062329 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.063113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.063559 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.226879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:27.235917 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-26fc725c-b5a7-4a8e-994c-b2cd5bf27376 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1364 microversion: 2.1 time: 0.225677 May 10 20:28:27.236890 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 86/171] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:27 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:27.241118 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:27.249113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:27.250638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:27.251820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ae252bc2-63aa-4187-a825-1d3cc7632275 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.201576 May 10 20:28:27.252369 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 86/172] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:27 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:28:27.305053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:27.305760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:27.311853 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.312297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.313096 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.313511 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.315210 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:27.315840 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:27.321675 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.322129 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.322902 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:27.323345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:27.502940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:27.505859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:27.511374 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-561f1ba6-920e-4960-9d52-b15c6bb5182e tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.210183 May 10 20:28:27.511954 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 87/173] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:27 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:27.513584 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e645c728-26f9-4b1d-beeb-008042a77c1d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.202035 May 10 20:28:27.514313 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 87/174] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:27 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:28.252135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:28.252663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:28.259081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.259527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.260284 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.260717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.269216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:28.269821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:28.276315 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.276791 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.277584 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.278031 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.445181 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:28.453080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a21af5f8-edc8-4c4c-92af-9a09a20be533 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1551 microversion: 2.1 time: 0.204795 May 10 20:28:28.453788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 88/175] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:28 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1551 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:28.454446 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:28.462538 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:28.464083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:28.465223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-648101b3-07e5-4f1b-a8b0-348218033fee tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.199915 May 10 20:28:28.465778 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 88/176] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:28 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:28.470410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2999b662-0b14-43e8-9130-747a83adbb0f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:28.470906 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2999b662-0b14-43e8-9130-747a83adbb0f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:28.477235 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2999b662-0b14-43e8-9130-747a83adbb0f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.477678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2999b662-0b14-43e8-9130-747a83adbb0f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.478435 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2999b662-0b14-43e8-9130-747a83adbb0f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.478871 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2999b662-0b14-43e8-9130-747a83adbb0f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.528688 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:28.529377 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:28.535348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.535805 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.536598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.537069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.556786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2999b662-0b14-43e8-9130-747a83adbb0f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090110 May 10 20:28:28.557412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 89/177] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:28:28 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:28:28.562021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:28.562627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:28.568793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.569274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.570055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:28.570492 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:28.945918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:28.953678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-eb3ca234-ab4b-4eec-8007-8229e5005e39 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.395278 May 10 20:28:28.954384 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 90/178] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:28 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:28.958729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:28.966571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3133238b-8b72-4d91-ac42-9184f8c51eea tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.441920 May 10 20:28:28.967454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 89/179] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:28 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:29.483036 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:29.483660 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:29.489660 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:29.490112 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:29.490888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:29.491339 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:29.747216 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:29.754887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:29.756395 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:29.757588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6efa8e0a-eb3b-4f08-84e7-585dc1da56b2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.278522 May 10 20:28:29.758154 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 91/180] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:29 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:29.970458 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:29.971307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:29.978974 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:29.979452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:29.980252 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:29.981137 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:29.984512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:29.986068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:29.992302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:29.992816 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:29.993691 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:29.994191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:30.248315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:30.258893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-845bd662-05d3-493c-8f4b-cafb917bc056 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.278748 May 10 20:28:30.259792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 92/181] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:29 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:30.272797 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:30.274856 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-1163f431-254b-4948-9a21-599ba56dcb22 req-5e2f2e5a-3159-45d6-8638-0cd5dcc6481e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f69eab-9bdc-4e34-a3ed-e7417bc13c95", "tag": "606fde48-a88c-4e4e-a204-c1d9ee0708f0"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:30.280310 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d909e6d6-deaf-4384-80d5-1cb93eda6042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.313671 May 10 20:28:30.289545 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 90/182] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:29 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:30.289743 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-1163f431-254b-4948-9a21-599ba56dcb22 req-5e2f2e5a-3159-45d6-8638-0cd5dcc6481e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:30.289743 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-1163f431-254b-4948-9a21-599ba56dcb22 req-5e2f2e5a-3159-45d6-8638-0cd5dcc6481e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:30.293969 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-1163f431-254b-4948-9a21-599ba56dcb22 req-5e2f2e5a-3159-45d6-8638-0cd5dcc6481e service nova] Creating event network-changed:606fde48-a88c-4e4e-a204-c1d9ee0708f0 for instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 on hv-cinder-82880 May 10 20:28:30.298968 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-1163f431-254b-4948-9a21-599ba56dcb22 req-5e2f2e5a-3159-45d6-8638-0cd5dcc6481e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029566 May 10 20:28:30.299551 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 93/183] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:28:30.775579 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:30.776535 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:30.782385 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:30.782843 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:30.783887 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:30.784486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:30.928035 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:30.936346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:30.938391 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:30.939729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ce40e1a7-789b-4d73-ab9c-74e6cee72ccd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.168316 May 10 20:28:30.940785 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 91/184] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:30 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:31.278665 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:31.279495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:31.285666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.286115 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:31.286882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.287322 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:31.297312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:31.297925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:31.305713 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.306353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:31.307144 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.307588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:31.426544 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:31.435595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b02d408f-103f-4edb-b67d-cec5dfb91a67 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.160681 May 10 20:28:31.436397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 94/185] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:31 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:31.576857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:31.584091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fde2a365-773b-4545-a4d7-90146d55f817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.290529 May 10 20:28:31.584646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 92/186] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:31 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:31.958148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:31.958749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:31.964583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.965051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:31.965802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:31.966229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:32.097573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:32.107530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:32.109084 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:32.110172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-da47b661-4157-4ade-8da6-1fe3d8023634 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.155918 May 10 20:28:32.110723 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 95/187] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:31 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:32.453256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:32.453819 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:32.460046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:32.461124 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:32.462007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:32.462440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:32.588746 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:32.596592 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8beeb130-61c5-41cd-b2b0-e69236ffcce1 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.147230 May 10 20:28:32.597172 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 93/188] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:32 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:32.601864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:32.602595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:32.608584 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:32.609072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:32.609840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:32.610276 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:32.737176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:32.744477 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f9e37288-8117-4053-934a-26b18fda919d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.147082 May 10 20:28:32.745075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 96/189] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:32 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:33.127335 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:33.128185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:33.134697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.135227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.136070 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.136585 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.301634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:33.310555 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:33.312125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:33.313193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-dd608223-feb7-4011-bb03-0fe9110786c8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1407 microversion: 2.20 time: 0.189662 May 10 20:28:33.323283 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 94/190] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:33 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:33.614048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:33.614657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:33.621251 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.621699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.622497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.622935 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.754277 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:33.762631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:33.763173 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e5df7696-28f3-4c54-ae6b-9cdf40633984 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.152672 May 10 20:28:33.773524 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 97/191] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:33 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:33.773724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:33.773724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.773724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.773724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:33.774000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:33.913630 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:33.920788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f7a331ef-cf4e-4ca7-b646-07336b290928 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.164013 May 10 20:28:33.921375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 95/192] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:33 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:34.331621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:34.332344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:34.338414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.338867 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.339705 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.340148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.466860 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:34.474594 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:34.476962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:34.478047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a8f456df-169d-4ff9-8673-320c97807e90 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1600 microversion: 2.20 time: 0.150696 May 10 20:28:34.478605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 98/193] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:28:34 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:28:34.496153 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a1f22189-bebf-4b00-9b77-89bfdfb7dc97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:34.496726 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a1f22189-bebf-4b00-9b77-89bfdfb7dc97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:34.503466 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a1f22189-bebf-4b00-9b77-89bfdfb7dc97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.504102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a1f22189-bebf-4b00-9b77-89bfdfb7dc97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.504898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a1f22189-bebf-4b00-9b77-89bfdfb7dc97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.505423 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a1f22189-bebf-4b00-9b77-89bfdfb7dc97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.590150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a1f22189-bebf-4b00-9b77-89bfdfb7dc97 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098357 May 10 20:28:34.590855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 96/194] 10.222.0.61 () {60 vars in 1315 bytes} [Tue May 10 20:28:34 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:28:34.779846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:34.780538 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:34.786274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.786728 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.787472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.787900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.936752 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:34.937407 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:34.943886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.944344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:34.945188 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:34.945633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:35.083898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:35.092263 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9cdf8a68-7e09-45a8-8600-ca460c9c9117 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.316263 May 10 20:28:35.093060 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 99/195] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:34 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:35.371249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:35.392227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-57bf6849-4310-43bb-ab2e-3ec144bbbcdc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.459366 May 10 20:28:35.401531 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 97/196] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:34 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:35.919374 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-47e90ba6-6358-45fb-a13d-30fcad1ceb23 req-882fa89d-e1b1-4146-a021-b6d2c59d9daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daa24eb7-cd9f-4ca7-bad7-5c275879fecd", "tag": "d8fb0937-0365-4e3b-b493-e0343c1b6efa"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:35.927266 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-47e90ba6-6358-45fb-a13d-30fcad1ceb23 req-882fa89d-e1b1-4146-a021-b6d2c59d9daa service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:35.927704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-47e90ba6-6358-45fb-a13d-30fcad1ceb23 req-882fa89d-e1b1-4146-a021-b6d2c59d9daa service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:35.938279 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-47e90ba6-6358-45fb-a13d-30fcad1ceb23 req-882fa89d-e1b1-4146-a021-b6d2c59d9daa service nova] Creating event network-changed:d8fb0937-0365-4e3b-b493-e0343c1b6efa for instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd on hv-cinder-82880 May 10 20:28:35.943459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-47e90ba6-6358-45fb-a13d-30fcad1ceb23 req-882fa89d-e1b1-4146-a021-b6d2c59d9daa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027725 May 10 20:28:35.944122 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 100/197] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:28:36.109953 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:36.110480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:36.116921 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:36.117399 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:36.118171 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:36.118607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:36.246797 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:36.255008 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4af5859b-b44c-4538-b315-9ddca5204a47 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.148999 May 10 20:28:36.255708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 98/198] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:36 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:36.409664 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:36.410583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:36.417756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:36.418150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:36.419055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:36.419588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:36.558035 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:36.565627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-28673bae-d506-4602-9a49-b037090af81d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.160294 May 10 20:28:36.566223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 101/199] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:36 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:36.937336 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-a514bbe7-f8c3-49a1-90b1-d31dbdf1116b req-51368b63-ed40-4e80-98cd-2da8c8c25a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3bfb8b-461f-42a5-b6d6-e91ba9d16461", "name": "network-vif-unplugged", "status": "completed", "tag": "347aa120-e5e6-4c00-837a-5f1f6cd8cd12"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:36.947383 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-a514bbe7-f8c3-49a1-90b1-d31dbdf1116b req-51368b63-ed40-4e80-98cd-2da8c8c25a55 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:36.948088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-a514bbe7-f8c3-49a1-90b1-d31dbdf1116b req-51368b63-ed40-4e80-98cd-2da8c8c25a55 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:36.962017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-a514bbe7-f8c3-49a1-90b1-d31dbdf1116b req-51368b63-ed40-4e80-98cd-2da8c8c25a55 service nova] Creating event network-vif-unplugged:347aa120-e5e6-4c00-837a-5f1f6cd8cd12 for instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 on hv-cinder-82880 May 10 20:28:36.967769 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-a514bbe7-f8c3-49a1-90b1-d31dbdf1116b req-51368b63-ed40-4e80-98cd-2da8c8c25a55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034300 May 10 20:28:36.968701 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 99/200] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:28:37.272198 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:37.273153 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:37.279149 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:37.279589 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:37.280570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:37.281019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:37.422952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:37.431663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2d395d0d-ba9d-45b0-93d2-750646116b96 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1553 microversion: 2.1 time: 0.163583 May 10 20:28:37.432253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 102/201] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:37 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:37.582934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:37.583641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:37.590316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:37.590776 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:37.591556 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:37.592002 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:37.803760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:37.814484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9677f9d2-c193-4124-b572-185ad2eae7ab tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.235661 May 10 20:28:37.815216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 100/202] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:37 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:38.392015 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-d9f7333b-cc75-4900-92fa-ff694d482fbb req-d33408cc-03e8-45c3-9662-4d901cbfb08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3bfb8b-461f-42a5-b6d6-e91ba9d16461", "name": "network-vif-deleted", "tag": "347aa120-e5e6-4c00-837a-5f1f6cd8cd12"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:38.400098 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-d9f7333b-cc75-4900-92fa-ff694d482fbb req-d33408cc-03e8-45c3-9662-4d901cbfb08d service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:38.400535 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-d9f7333b-cc75-4900-92fa-ff694d482fbb req-d33408cc-03e8-45c3-9662-4d901cbfb08d service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:38.411106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-d9f7333b-cc75-4900-92fa-ff694d482fbb req-d33408cc-03e8-45c3-9662-4d901cbfb08d service nova] Creating event network-vif-deleted:347aa120-e5e6-4c00-837a-5f1f6cd8cd12 for instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 on hv-cinder-82880 May 10 20:28:38.416563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-d9f7333b-cc75-4900-92fa-ff694d482fbb req-d33408cc-03e8-45c3-9662-4d901cbfb08d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028140 May 10 20:28:38.417088 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 103/203] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:28:38.451836 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:38.452484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:38.458446 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:38.458900 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:38.459674 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:38.460622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:38.520054 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:38.529754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7c70e487-865e-422c-b7a4-83434e0da430 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1511 microversion: 2.1 time: 0.081009 May 10 20:28:38.540306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 101/204] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:38 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1511 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:38.832756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:38.833512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:38.839600 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:38.840053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:38.840870 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:38.841427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:39.004590 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:39.013144 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0d628cff-32a5-4554-b739-265e9cf235f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1322 microversion: 2.1 time: 0.184822 May 10 20:28:39.013724 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 104/205] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:38 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:39.549562 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:39.550342 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:39.557751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:39.564905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:39.566178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:39.566905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:39.635676 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:39.636414 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:39.637284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lazy-loading 'fault' on Instance uuid 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:28:39.730261 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45ecca878e5d46cabb3471d7ef14c2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86827b1ba384ed9b24e7e6afd65a4d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:39.744947 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2a6c6f03-8711-4ae9-ac16-d948a1e2d279 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 200 len: 1351 microversion: 2.1 time: 0.199575 May 10 20:28:39.745885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 102/206] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:39 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 1351 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:40.031780 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:40.032848 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:40.056578 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.058327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.059673 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.060410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.245916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:40.253717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-17e368df-d8af-4a2f-9289-1e2b55857449 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1516 microversion: 2.1 time: 0.226880 May 10 20:28:40.266759 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 105/207] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:40 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1516 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:40.272000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:40.273380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:40.281832 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.282540 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.283548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.284307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.312980 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lazy-loading 'flavor' on Instance uuid 7863f3c8-d62c-4cc1-be62-0902625d59fe {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:28:40.464040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a88ad5e1-6130-414b-89ad-4199bb6152bd tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe/action" status: 200 len: 32 microversion: 2.1 time: 0.195570 May 10 20:28:40.476699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:40.477490 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:40.481572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 103/208] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:28:40 2022] POST /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe/action => generated 32 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:28:40.484862 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.485594 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.486726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.487415 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.764495 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:40.765000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:40.765250 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:40.776761 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.777557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.779169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:40.780014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5762b51d-bbc8-4d28-afc6-4279182f9250 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.309126 May 10 20:28:40.780666 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:40.784244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 106/209] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:40 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:40.798267 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] HTTP exception thrown: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Request method failure captured: May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 HTTP/1.1 May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesqkuRA3MdOKkr5CwCwuvvRZgc2FzuG6RlrtPD6v0ES_mNX5yhvI0vy1L7zS84ZwGQR3YiR_4gIgLQk3JHvlv4u6zz4r62GukuvaYM_Ds0q2DDnSo8gm7mxPd3ZDY7iuzy_FJAtIl5f18i143fELTpelPGTiXotJu9zSLKUUgbhqG9I May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:28:40.804256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c86827b1ba384ed9b24e7e6afd65a4d5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 45ecca878e5d46cabb3471d7ef14c2d0 May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:40.805784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '5a3bfb8b-461f-42a5-b6d6-e91ba9d16461'} May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:28:40.806782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:40.807923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:40.811624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Returning 404 to user: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:28:40.812696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1dc3e48b-4fb4-44a7-8057-e6b46b15cbaa tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 404 len: 111 microversion: 2.1 time: 0.053593 May 10 20:28:40.814173 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 104/210] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:40 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:28:41.015792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:41.018651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:41.033686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:41.034902 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:41.037086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:41.040301 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:41.066547 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] HTTP exception thrown: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Request method failure captured: May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461/os-volume_attachments HTTP/1.1 May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqkuRA3MdOKkr5CwCwuvvRZgc2FzuG6RlrtPD6v0ES_mNX5yhvI0vy1L7zS84ZwGQR3YiR_4gIgLQk3JHvlv4u6zz4r62GukuvaYM_Ds0q2DDnSo8gm7mxPd3ZDY7iuzy_FJAtIl5f18i143fELTpelPGTiXotJu9zSLKUUgbhqG9I May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:28:41.093879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c86827b1ba384ed9b24e7e6afd65a4d5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 45ecca878e5d46cabb3471d7ef14c2d0 May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:41.095111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'server_id': '5a3bfb8b-461f-42a5-b6d6-e91ba9d16461'} May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:28:41.095845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:41.097898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:41.105300 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Returning 404 to user: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:28:41.106388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-269c8600-0c98-4e30-8fa0-2c461d201b46 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.096276 May 10 20:28:41.108393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 107/211] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:28:41 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461/os-volume_attachments => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:28:41.800513 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:41.801619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:41.811111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:41.811571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:41.812349 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:41.813049 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:41.956489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:41.974064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-69f13848-5cbd-40f8-a4eb-d99b8f8dac07 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.171869 May 10 20:28:41.974703 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 105/212] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:41 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:42.448792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:42.449899 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:42.457874 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:42.458550 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:42.459488 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:42.460644 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:42.490303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] HTTP exception thrown: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Request method failure captured: May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 HTTP/1.1 May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqkuRA3MdOKkr5CwCwuvvRZgc2FzuG6RlrtPD6v0ES_mNX5yhvI0vy1L7zS84ZwGQR3YiR_4gIgLQk3JHvlv4u6zz4r62GukuvaYM_Ds0q2DDnSo8gm7mxPd3ZDY7iuzy_FJAtIl5f18i143fELTpelPGTiXotJu9zSLKUUgbhqG9I May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:28:42.495441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c86827b1ba384ed9b24e7e6afd65a4d5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 45ecca878e5d46cabb3471d7ef14c2d0 May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.496655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '5a3bfb8b-461f-42a5-b6d6-e91ba9d16461'} May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:28:42.497347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.498406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:28:42.499497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Returning 404 to user: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:28:42.499497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ac7243cc-f42d-455c-bade-ac6bed178c53 tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 404 len: 111 microversion: 2.1 time: 0.053215 May 10 20:28:42.512883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:42.513527 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] [instance: 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:42.525114 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 108/213] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:28:42 2022] DELETE /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:28:42.530594 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:42.531879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:42.534247 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:42.535073 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:42.570732 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] HTTP exception thrown: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Request method failure captured: May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 HTTP/1.1 May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesqkuRA3MdOKkr5CwCwuvvRZgc2FzuG6RlrtPD6v0ES_mNX5yhvI0vy1L7zS84ZwGQR3YiR_4gIgLQk3JHvlv4u6zz4r62GukuvaYM_Ds0q2DDnSo8gm7mxPd3ZDY7iuzy_FJAtIl5f18i143fELTpelPGTiXotJu9zSLKUUgbhqG9I May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:28:42.578480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c86827b1ba384ed9b24e7e6afd65a4d5", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c86827b1ba384ed9b24e7e6afd65a4d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: c86827b1ba384ed9b24e7e6afd65a4d5 May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-DeleteServersTestJSON-1934862471 May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 45ecca878e5d46cabb3471d7ef14c2d0 May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-DeleteServersTestJSON-1934862471-project May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.579865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '5a3bfb8b-461f-42a5-b6d6-e91ba9d16461'} May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:28:42.581078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. May 10 20:28:42.582152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:28:42.586208 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] Returning 404 to user: Instance 5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:28:42.587488 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-673e5bac-a2de-4881-bedb-7378ae4d537a tempest-DeleteServersTestJSON-1934862471 tempest-DeleteServersTestJSON-1934862471-project] 10.222.0.61 "GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461" status: 404 len: 111 microversion: 2.1 time: 0.083696 May 10 20:28:42.588879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 106/214] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:42 2022] GET /compute/v2.1/servers/5a3bfb8b-461f-42a5-b6d6-e91ba9d16461 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:28:42.996591 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:42.997415 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:43.006912 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:43.007778 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:43.009382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:43.010158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:43.192278 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:43.201231 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-73e3b04d-7541-4a73-9349-4f2190df3f4d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.212362 May 10 20:28:43.205331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 109/215] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:42 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:44.218449 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:44.219069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:44.230598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:44.231112 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:44.232161 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:44.232368 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:44.419721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:44.428078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0d93f692-d611-454f-99a4-85c2516ca85c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.213983 May 10 20:28:44.429346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 107/216] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:44 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:45.445500 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:45.446148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:45.452565 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:45.453092 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:45.454131 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:45.454714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:45.596503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:45.604568 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-54b8ab02-c291-41a7-894d-769fc40280e2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.163138 May 10 20:28:45.605192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 110/217] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:45 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:46.621765 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:46.622375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:46.629211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:46.629624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:46.630633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:46.631070 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:46.829145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:46.838637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6e3a5f92-4828-4a22-8791-ee73b89dec36 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.220605 May 10 20:28:46.839217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 108/218] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:46 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:47.854927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:47.855441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:47.861361 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:47.861862 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:47.862709 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:47.863228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:48.002095 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:48.011963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4d163159-10b8-4e0d-ae4a-37afd74a3bd9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.160877 May 10 20:28:48.012579 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 111/219] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:47 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:49.028460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:49.029103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:49.035661 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:49.036115 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:49.036883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:49.037368 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:49.170192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:49.177701 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8e406654-06b6-4f60-b272-750eb526e743 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.153029 May 10 20:28:49.178267 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 109/220] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:49 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:50.194031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:50.195085 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:50.200651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:50.201138 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:50.201887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:50.202319 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:50.332997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:50.349671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ba12ca33-44d2-422a-9199-476cac1b7a1c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.151364 May 10 20:28:50.349671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 112/221] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:50 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:51.361186 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:51.361186 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:51.366255 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:51.366706 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:51.367485 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:51.367926 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:51.496385 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:51.505810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0f439d97-a895-48b4-9422-12ee78f8e901 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.150085 May 10 20:28:51.507472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 110/222] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:51 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:52.524057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:52.524672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:52.530566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:52.530919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:52.531685 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:52.532151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:52.659609 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:52.667005 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c7e24708-fab6-4534-8e2b-ce319f03c44e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.147503 May 10 20:28:52.667846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 113/223] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:52 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:53.684777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:53.685973 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:53.693692 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:53.694757 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:53.695567 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:53.696415 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:53.824011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:53.831555 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ca703ade-b9a6-40c1-82d3-bbce85b08530 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.150885 May 10 20:28:53.832106 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 111/224] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:53 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:54.848672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:54.849372 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:54.855581 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:54.856026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:54.856792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:54.857330 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:55.007303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:55.020017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fad11a41-e09a-4f5e-bf8e-ca00f45aa10c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.175264 May 10 20:28:55.030621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 114/225] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:54 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:55.270554 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2077115456", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "networks": [{"uuid": "db973cef-69d1-4d44-9c77-fbbd27082c06"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:28:55.328959 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] validate_networks() for [('db973cef-69d1-4d44-9c77-fbbd27082c06', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:28:55.951866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:28:55.952289 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:28:55.952765 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:28:55.953217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:28:55.953631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:28:55.963831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:55.964315 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:55.965111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:55.965548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:55.989651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Getting quotas for project a24528148d9444038c71b83c90aa026e. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:28:55.994294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Getting quotas for user 968e45f60cb74bd9b16b2c74801071fb and project a24528148d9444038c71b83c90aa026e. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:28:56.005353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:28:56.008534 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:28:56.037257 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:56.038526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:56.053917 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:56.054728 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:56.056009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:56.056748 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:56.063572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bad94674-38c4-4a0b-801d-4bd472f45a1f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796716 May 10 20:28:56.064227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 112/226] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:28:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:28:56.074943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-72016e59-8c1c-402d-9a27-83e99afb3f07 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:56.075894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-72016e59-8c1c-402d-9a27-83e99afb3f07 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:56.159274 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-72016e59-8c1c-402d-9a27-83e99afb3f07 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:56.171008 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-72016e59-8c1c-402d-9a27-83e99afb3f07 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1214 microversion: 2.1 time: 0.099050 May 10 20:28:56.172186 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 113/227] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:56 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:56.271092 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:56.279074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9d150b51-944b-4ac1-9730-09860201dcd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.245490 May 10 20:28:56.283706 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 115/228] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:56 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:57.190201 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:57.192194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:57.207853 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:57.208673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:57.210457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:57.211293 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:57.302603 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:57.304551 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:57.318592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:57.320081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:57.321232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:57.321722 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:57.322315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:57.330901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e87b299a-ed36-4ea4-a8dc-9a4d8bc64c7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1218 microversion: 2.1 time: 0.145630 May 10 20:28:57.331496 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 114/229] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:57 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:57.462567 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:57.471204 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-38be990b-363c-4b5d-a98d-24e1ff7461f3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.172892 May 10 20:28:57.471888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 116/230] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:57 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:28:58.348778 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:58.350718 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:58.358027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:58.358469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:58.359415 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:58.359909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:58.426317 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:58.434853 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d67378e5-2ea0-485f-9fa1-53bb39a3d459 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1210 microversion: 2.1 time: 0.091090 May 10 20:28:58.436217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 115/231] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:58 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:58.487453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:58.488071 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:58.494459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:58.495139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:58.495916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:58.496351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:58.649887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:58.663445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d20edbc4-3f51-4486-a5f8-f70b917911c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.179115 May 10 20:28:58.664236 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 117/232] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:58 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:59.451883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:59.452609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:59.477935 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:59.480843 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:59.481866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:59.484225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:59.578530 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:59.595729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1bf0d8c6-9a06-4471-87b9-8730ba712a8b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1272 microversion: 2.1 time: 0.146786 May 10 20:28:59.597833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 116/233] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:59 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:28:59.680087 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:28:59.680696 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:28:59.691740 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:59.692288 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:59.693177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:28:59.693730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:28:59.848469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:28:59.857110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f520e385-ac2d-4e08-a7cf-3f07cf646f06 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.181384 May 10 20:28:59.857723 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 118/234] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:28:59 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:00.615819 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:00.616880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:00.635652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:00.636437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:00.637408 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:00.637950 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:00.700373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-2872490d-6707-4ef9-a7cc-ef9b6cc28555 req-7f9ad017-9dd4-48fd-b007-3a40716b92e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b474b428-fdef-45e0-91c5-65e510be2331", "tag": "852f95c8-1e42-404b-b6c8-0fe103d21da5"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:00.719060 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-2872490d-6707-4ef9-a7cc-ef9b6cc28555 req-7f9ad017-9dd4-48fd-b007-3a40716b92e0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:00.720297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-2872490d-6707-4ef9-a7cc-ef9b6cc28555 req-7f9ad017-9dd4-48fd-b007-3a40716b92e0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:00.755908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-2872490d-6707-4ef9-a7cc-ef9b6cc28555 req-7f9ad017-9dd4-48fd-b007-3a40716b92e0 service nova] Creating event network-changed:852f95c8-1e42-404b-b6c8-0fe103d21da5 for instance b474b428-fdef-45e0-91c5-65e510be2331 on hv-cinder-82880 May 10 20:29:00.768425 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-2872490d-6707-4ef9-a7cc-ef9b6cc28555 req-7f9ad017-9dd4-48fd-b007-3a40716b92e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074930 May 10 20:29:00.772962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 119/235] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:00.813556 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:00.820898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-607d6af8-1cd4-4dad-9e59-c81fad6c745d tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.209577 May 10 20:29:00.821694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 117/236] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:00 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:00.874296 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:00.875173 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:00.881441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:00.881990 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:00.882842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:00.883332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:01.037267 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:01.045742 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9cdd0071-340f-40d3-8275-2ed808c11533 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.175451 May 10 20:29:01.046283 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 120/237] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:00 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:01.837696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:01.838317 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:01.844730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:01.845411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:01.846410 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:01.846854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:01.983114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:01.990952 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-782ad7a1-383d-40f0-882d-bace010d1697 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.156531 May 10 20:29:01.991500 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 118/238] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:01 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:02.062162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:02.062697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:02.068570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:02.069610 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:02.070383 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:02.070826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:02.192499 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:02.199708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8fd404b8-4176-48e5-8317-a3a114aea437 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.141565 May 10 20:29:02.200280 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 121/239] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:02 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:03.010875 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:03.011489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:03.018960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:03.019420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:03.020204 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:03.020655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:03.185486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:03.193465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bf696332-b666-4b54-9dcf-4fa38542fdc1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.186665 May 10 20:29:03.194111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 119/240] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:03 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:03.216080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:03.217082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:03.223044 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:03.223434 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:03.224214 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:03.224659 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:03.362801 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:03.370185 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a2afa122-96c7-4c82-8b23-0b7ce7f347d6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.157954 May 10 20:29:03.370752 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 122/241] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:03 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:04.210118 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:04.210742 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:04.217045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:04.217507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:04.218284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:04.218729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:04.350839 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:04.358550 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-64b65038-d8b1-4683-bec5-bf1f592de52f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.152240 May 10 20:29:04.359214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 120/242] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:04 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:04.386905 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:04.387512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:04.393493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:04.393946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:04.394718 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:04.395155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:04.525613 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:04.532933 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-876022a4-0ebf-4862-9b6a-b7a94d9f011f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.149869 May 10 20:29:04.533531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 123/243] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:04 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:05.375894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:05.376497 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:05.383896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:05.384345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:05.385133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:05.385649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:05.513063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:05.520485 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e9046b6e-ad74-41e1-acd5-e820c7b2b0d9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.148468 May 10 20:29:05.521177 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 121/244] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:05 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:05.550592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:05.551101 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:05.557477 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:05.557930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:05.558692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:05.559127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:05.694896 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:05.702585 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ce0f3881-f43b-4da7-88f6-fda225a6e222 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.155943 May 10 20:29:05.703184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 124/245] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:05 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:06.538205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:06.538845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:06.545462 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:06.545918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:06.546821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:06.547289 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:06.678356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:06.685699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d735e5ea-6ffd-421a-8ed1-a3a241adf574 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.152066 May 10 20:29:06.686277 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 122/246] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:06 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:06.718930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:06.719537 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:06.727828 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:06.729116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:06.729116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:06.729488 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:06.854794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:06.862305 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6b4ab907-e34e-4579-a411-d4a444390d42 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.147336 May 10 20:29:06.862868 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 125/247] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:06 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:06.909041 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1177526428", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:06.956309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] validate_networks() for None {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:29:07.228236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:29:07.228663 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:29:07.229175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:29:07.229593 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:29:07.230014 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:29:07.238863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.239391 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.240335 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.240852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.257525 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Getting quotas for project 00d5dc630aa047e2b28547fb11db324f. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:29:07.261216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Getting quotas for user 509c75788fdc46e6aa15096f8a43071c and project 00d5dc630aa047e2b28547fb11db324f. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:29:07.274644 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:29:07.277179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:29:07.331117 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-69142053-0917-4ba5-80fd-c3a89f1460e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.425788 May 10 20:29:07.332184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 123/248] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:29:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:29:07.343464 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-baaaf854-4526-4f16-877d-3673a369c8e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:07.344213 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-baaaf854-4526-4f16-877d-3673a369c8e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:07.424059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-baaaf854-4526-4f16-877d-3673a369c8e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:07.434957 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-baaaf854-4526-4f16-877d-3673a369c8e8 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1215 microversion: 2.1 time: 0.095341 May 10 20:29:07.436302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 126/249] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:07 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1215 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:07.482442 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-5a702912-5e32-4cc8-9fd8-9fedeba75bf3 req-cd3d6f7e-5405-4d29-a561-ccd0c6dadb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b474b428-fdef-45e0-91c5-65e510be2331", "name": "network-vif-plugged", "status": "completed", "tag": "852f95c8-1e42-404b-b6c8-0fe103d21da5"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:07.503541 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-5a702912-5e32-4cc8-9fd8-9fedeba75bf3 req-cd3d6f7e-5405-4d29-a561-ccd0c6dadb1a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.504611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-5a702912-5e32-4cc8-9fd8-9fedeba75bf3 req-cd3d6f7e-5405-4d29-a561-ccd0c6dadb1a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.529192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-5a702912-5e32-4cc8-9fd8-9fedeba75bf3 req-cd3d6f7e-5405-4d29-a561-ccd0c6dadb1a service nova] Creating event network-vif-plugged:852f95c8-1e42-404b-b6c8-0fe103d21da5 for instance b474b428-fdef-45e0-91c5-65e510be2331 on hv-cinder-82880 May 10 20:29:07.536253 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-5a702912-5e32-4cc8-9fd8-9fedeba75bf3 req-cd3d6f7e-5405-4d29-a561-ccd0c6dadb1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058062 May 10 20:29:07.537622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 124/250] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:07.712414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:07.714213 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:07.728347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.729568 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.730912 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.731596 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.880892 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:07.882093 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:07.889234 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.889691 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.890482 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:07.890929 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:07.947212 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:07.957711 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d5e4f59f-422a-4255-bdab-1eb7f1f24bcd tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.256532 May 10 20:29:07.958962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 127/251] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:07 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:08.082910 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:08.090884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-efe65d4b-88e4-4592-9114-2f6851c46d9d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.214788 May 10 20:29:08.091460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 125/252] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:07 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:08.452227 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:08.453040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:08.459647 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:08.460538 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:08.461531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:08.462119 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:08.531790 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:08.540645 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d618aac0-6df3-4d6e-bad6-ffbf4855a07e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1267 microversion: 2.1 time: 0.092179 May 10 20:29:08.541757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 128/253] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:08 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:08.977356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:08.978582 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:08.991816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:08.992660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:08.994019 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:08.994756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:09.116805 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:09.118076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:09.134189 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:09.134823 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:09.137338 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:09.138526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:09.248393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:09.263873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1745cb3e-3032-4ef2-8f39-771fb0d22af0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1314 microversion: 2.1 time: 0.291908 May 10 20:29:09.276083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 126/254] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:08 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:09.359109 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:09.372511 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-59743319-30ea-487d-915e-c9cfe4c14904 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.267804 May 10 20:29:09.372511 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 129/255] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:09 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:09.560244 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:09.560873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:09.567324 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:09.567848 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:09.569240 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:09.569758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:09.640866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:09.649611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b2d98602-47e9-404c-b3cc-4ca833b180db tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1275 microversion: 2.1 time: 0.094245 May 10 20:29:09.650740 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 127/256] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:09 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1275 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:10.284609 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:10.285900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:10.294390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.295004 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.296109 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.296902 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.388620 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:10.389263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:10.402211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.403223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.404684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.408900 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.445005 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:10.453568 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-80346317-918d-4ed8-8ea1-c731fb13b6a0 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1497 microversion: 2.1 time: 0.173485 May 10 20:29:10.454147 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 130/257] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:10 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1497 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:10.589730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:10.598595 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3e3d74a3-25c4-4179-ac92-c6afdc07536d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.213716 May 10 20:29:10.608912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 128/258] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:10 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:10.669419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:10.670687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:10.680392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.681428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.682443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:10.683150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:10.791767 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:10.803725 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-15beeb59-fc61-4291-94cf-4e1bc6dc3a0f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1273 microversion: 2.1 time: 0.138570 May 10 20:29:10.812246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 131/259] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:10 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1273 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:11.111548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:11.112049 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:11.119788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.120517 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.121526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.122145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.156271 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:29:11.311223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f7ee274a-dd51-4efc-92bf-9ccda745c75b tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 204 len: 0 microversion: 2.1 time: 0.203500 May 10 20:29:11.312105 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 129/260] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:29:11 2022] DELETE /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:29:11.321765 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:11.322254 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:11.328888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.329387 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.330168 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.330604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.515007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:11.525295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8b15a0c6-e679-42bf-adf0-ddb419f68ad1 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1503 microversion: 2.1 time: 0.208257 May 10 20:29:11.526285 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 132/261] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:11 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:11.617975 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:11.618682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:11.625622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.626074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.627066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.627514 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.763447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:11.771906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-863cbaad-956e-440f-ab55-5eb83fe3dc97 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.157851 May 10 20:29:11.772747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 130/262] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:11 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:11.829296 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:11.830093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:11.836259 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.836889 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:11.837850 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:11.838462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:12.003068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:12.012383 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c3f3539a-b4e8-4ef7-a634-d24f2ef2cf30 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.187580 May 10 20:29:12.013540 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 133/263] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:11 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:12.543040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:12.543826 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:12.549947 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:12.550401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:12.551178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:12.551615 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:12.700391 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:12.710622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3cc3b648-2b5b-4c4e-9694-21680a17e41c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1503 microversion: 2.1 time: 0.171300 May 10 20:29:12.711297 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 131/264] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:12 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:12.789269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:12.789782 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:12.795451 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:12.795895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:12.796656 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:12.797114 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:12.935065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:12.944040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9bb83add-1d3f-4e44-8bba-3151c62c04b6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.158168 May 10 20:29:12.944820 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 134/265] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:12 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:13.029088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:13.029697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:13.036090 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.036358 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.037201 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.037638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.221303 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:13.232125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0623a8f1-d7f2-47c2-8ce1-ae6261d9dbc9 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.206779 May 10 20:29:13.233237 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 132/266] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:13 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:13.592699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-586b2ee3-3492-4c37-91a6-51293dd624d3 req-edc82266-5c7c-44fa-aa55-b15eaf3a516b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e6d15d-8fa1-4284-a294-6082bc7fb7d1", "tag": "26e8a4d3-7676-4091-b213-98ee10e1293a"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:13.602514 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-586b2ee3-3492-4c37-91a6-51293dd624d3 req-edc82266-5c7c-44fa-aa55-b15eaf3a516b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.603229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-586b2ee3-3492-4c37-91a6-51293dd624d3 req-edc82266-5c7c-44fa-aa55-b15eaf3a516b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.614714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-586b2ee3-3492-4c37-91a6-51293dd624d3 req-edc82266-5c7c-44fa-aa55-b15eaf3a516b service nova] Creating event network-changed:26e8a4d3-7676-4091-b213-98ee10e1293a for instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 on hv-cinder-82880 May 10 20:29:13.619816 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-586b2ee3-3492-4c37-91a6-51293dd624d3 req-edc82266-5c7c-44fa-aa55-b15eaf3a516b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031336 May 10 20:29:13.620424 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 135/267] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:13.728254 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:13.729191 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:13.738646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.739094 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.739911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.740882 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.907934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:13.916727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ffb4ebd2-1c72-4d49-9736-4d53c8edb95e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1503 microversion: 2.1 time: 0.192302 May 10 20:29:13.926290 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 133/268] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:13 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:13.961375 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:13.962200 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:13.968995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.969700 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:13.970518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:13.971088 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:14.101214 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:14.110612 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c704c1d2-113b-4615-b3c4-58d218e5f22c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.153450 May 10 20:29:14.111738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 136/269] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:13 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:14.250283 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:14.250920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:14.256640 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:14.257129 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:14.257896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:14.258331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:14.392649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:14.401481 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c4fe3469-ab7b-4ca2-b7d4-61ceb19096c1 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.155030 May 10 20:29:14.402059 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 134/270] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:14 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:14.933633 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:14.934242 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:14.941870 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:14.944137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:14.945160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:14.946654 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:15.135003 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:15.136792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:15.147239 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:15.147995 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:15.149298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:15.149990 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:15.185290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:15.194482 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1327c390-e73d-4fea-bcf9-0d2dad8afab4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1503 microversion: 2.1 time: 0.264590 May 10 20:29:15.205318 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 137/271] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:14 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1503 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:15.328412 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:15.339865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4b0b53c8-36b3-4aa8-bc75-488184f2fd9a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.212069 May 10 20:29:15.340478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 135/272] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:15 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:15.419006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:15.420266 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:15.429386 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:15.430020 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:15.431430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:15.432076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:15.617531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:15.626980 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-281d0290-b2ab-4f0c-bd72-56a04298bdf5 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.212365 May 10 20:29:15.627745 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 138/273] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:15 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:15.766358 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-ab7ffd64-e785-483a-b68e-8e574185e001 req-905bca86-46aa-4f29-a6ab-8f03810caa73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b474b428-fdef-45e0-91c5-65e510be2331", "name": "network-vif-deleted", "tag": "852f95c8-1e42-404b-b6c8-0fe103d21da5"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:15.777898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-ab7ffd64-e785-483a-b68e-8e574185e001 req-905bca86-46aa-4f29-a6ab-8f03810caa73 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:15.778429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-ab7ffd64-e785-483a-b68e-8e574185e001 req-905bca86-46aa-4f29-a6ab-8f03810caa73 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:15.795890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-ab7ffd64-e785-483a-b68e-8e574185e001 req-905bca86-46aa-4f29-a6ab-8f03810caa73 service nova] Creating event network-vif-deleted:852f95c8-1e42-404b-b6c8-0fe103d21da5 for instance b474b428-fdef-45e0-91c5-65e510be2331 on hv-cinder-82880 May 10 20:29:15.801291 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-ab7ffd64-e785-483a-b68e-8e574185e001 req-905bca86-46aa-4f29-a6ab-8f03810caa73 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038501 May 10 20:29:15.801890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 136/274] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:16.212093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:16.212911 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:16.223938 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.224952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.226015 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.226602 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.313333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:16.322553 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5709145e-6896-4e28-82cf-bd72b206b163 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 200 len: 1461 microversion: 2.1 time: 0.114785 May 10 20:29:16.322950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 139/275] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:16 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 1461 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:16.356608 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:16.357326 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:16.363568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.364030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.364927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.365445 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.501109 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:16.510401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b962d122-9043-47db-bd70-c0c9fcaccd20 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.158269 May 10 20:29:16.511146 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 137/276] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:16 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:16.644147 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:16.644340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:16.650489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.651101 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.651871 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:16.652305 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:16.824337 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:16.832694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6978a813-0253-4424-95b6-edd81fab0823 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.192912 May 10 20:29:16.833437 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 140/277] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:16 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:17.340947 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:17.341587 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: b474b428-fdef-45e0-91c5-65e510be2331] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:17.347528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.348251 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:17.350087 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.350712 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:17.367081 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] HTTP exception thrown: Instance b474b428-fdef-45e0-91c5-65e510be2331 could not be found. May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Request method failure captured: May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 HTTP/1.1 May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiessF6o4hiJUSORKPVdTSYeU5rHz9wqSHiMdcOkOuMOPmV5Fv9DAzLJYESCDxJ5JHGO-g7lYD8RMoIBDYkJgRmebsheJmNvNvEoJjCKX9ANgnX6AV-mEyDrkE0ECCvojV5NgMvjM3EQLortLIFKm_YWRb7wNA5CGDg42CVtD36wII1bA May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: a24528148d9444038c71b83c90aa026e May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesActionsTest-580968936 May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:29:17.369373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a24528148d9444038c71b83c90aa026e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a24528148d9444038c71b83c90aa026e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a24528148d9444038c71b83c90aa026e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a24528148d9444038c71b83c90aa026e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesActionsTest-580968936 May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: a24528148d9444038c71b83c90aa026e May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesActionsTest-580968936 May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesActionsTest-580968936-project May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 968e45f60cb74bd9b16b2c74801071fb May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesActionsTest-580968936-project May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance b474b428-fdef-45e0-91c5-65e510be2331 could not be found. May 10 20:29:17.370566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'b474b428-fdef-45e0-91c5-65e510be2331'} May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b474b428-fdef-45e0-91c5-65e510be2331 could not be found. May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:29:17.371345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b474b428-fdef-45e0-91c5-65e510be2331 could not be found. May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b474b428-fdef-45e0-91c5-65e510be2331 could not be found. May 10 20:29:17.372455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:17.374955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Returning 404 to user: Instance b474b428-fdef-45e0-91c5-65e510be2331 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:29:17.376149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e4092740-1edc-4c8d-880c-e0be7f0ce8ef tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331" status: 404 len: 111 microversion: 2.1 time: 0.041055 May 10 20:29:17.377452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 138/278] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:17 2022] GET /compute/v2.1/servers/b474b428-fdef-45e0-91c5-65e510be2331 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:29:17.515214 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1017988142", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "networks": [{"uuid": "db973cef-69d1-4d44-9c77-fbbd27082c06"}]}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:17.528321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:17.528940 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:17.537660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.538101 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:17.538898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.545700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:17.573630 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] validate_networks() for [('db973cef-69d1-4d44-9c77-fbbd27082c06', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:29:17.791125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:17.800297 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-cfaaf178-c67e-4ad0-84a2-567621bf77a4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.275750 May 10 20:29:17.801367 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 139/279] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:17 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:17.850758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:17.851553 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:17.858463 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.858912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:17.859703 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:17.860144 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:18.110754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:18.118775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1041197f-b90c-4e65-88b4-3db782db4b28 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.272676 May 10 20:29:18.120092 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 140/280] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:17 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:18.174261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:29:18.174710 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:29:18.175375 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:29:18.175908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:29:18.176349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:29:18.185340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:18.185778 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:18.186580 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:18.187009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:18.205485 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Getting quotas for project a24528148d9444038c71b83c90aa026e. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:29:18.210390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Getting quotas for user 968e45f60cb74bd9b16b2c74801071fb and project a24528148d9444038c71b83c90aa026e. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:29:18.222186 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:29:18.224886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:29:18.285555 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-dd4305e5-00b8-497f-ad6f-b25833f21676 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.775089 May 10 20:29:18.286208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 141/281] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:29:18.296211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e1683fde-33ae-478e-a929-1ffb099c310e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:18.296912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e1683fde-33ae-478e-a929-1ffb099c310e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:18.370220 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e1683fde-33ae-478e-a929-1ffb099c310e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:18.377952 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e1683fde-33ae-478e-a929-1ffb099c310e tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1214 microversion: 2.1 time: 0.085590 May 10 20:29:18.378886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 141/282] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:18 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:18.822096 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:18.823408 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:18.843207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:18.845347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:18.848139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:18.848605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:19.136404 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:19.138236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:19.145113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:19.145888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:19.148076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:19.150128 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:19.454615 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:19.464964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1d79af26-ee83-4988-8722-57e8fb1e205c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.651589 May 10 20:29:19.466674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 142/283] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:18 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:19.475361 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:19.476351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:19.485407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:19.486950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:19.488673 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:19.495604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:19.526614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:19.546575 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-73e4031f-77da-44f0-823e-b51143360e33 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.411763 May 10 20:29:19.547872 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 142/284] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:19 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:19.604725 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:19.617656 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5fad52cf-ab25-42f5-902a-a12c1b763166 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1266 microversion: 2.1 time: 0.149207 May 10 20:29:19.621353 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 143/285] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:19 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:20.506945 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:20.507878 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:20.520275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:20.521502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:20.523376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:20.526759 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:20.572665 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:20.573323 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:20.594679 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:20.596767 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:20.598942 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:20.601715 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:21.063111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:21.068302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:21.084908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d740d0be-93bf-4080-a7db-459b13a817ad tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.604930 May 10 20:29:21.087542 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 143/286] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:20 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:21.092363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cf635f5e-d538-4ca4-b621-dcd31845428c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.522642 May 10 20:29:21.095223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:21.096093 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:21.103764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 144/287] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:20 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:21.106409 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:21.107565 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:21.108365 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:21.108864 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:21.351053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:21.364663 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9ff34153-c949-4c63-9b6f-718b12c58c71 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.275456 May 10 20:29:21.365662 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 144/288] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:21 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:21.938764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-d510fe42-0c3f-48fd-820a-ab410bea9ca1 req-162de376-d03b-43f4-95ee-20245ccf26f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e6d15d-8fa1-4284-a294-6082bc7fb7d1", "name": "network-vif-plugged", "status": "completed", "tag": "26e8a4d3-7676-4091-b213-98ee10e1293a"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:21.953873 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-d510fe42-0c3f-48fd-820a-ab410bea9ca1 req-162de376-d03b-43f4-95ee-20245ccf26f3 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:21.954317 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-d510fe42-0c3f-48fd-820a-ab410bea9ca1 req-162de376-d03b-43f4-95ee-20245ccf26f3 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:21.997433 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-d510fe42-0c3f-48fd-820a-ab410bea9ca1 req-162de376-d03b-43f4-95ee-20245ccf26f3 service nova] Creating event network-vif-plugged:26e8a4d3-7676-4091-b213-98ee10e1293a for instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 on hv-cinder-82880 May 10 20:29:22.022838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-d510fe42-0c3f-48fd-820a-ab410bea9ca1 req-162de376-d03b-43f4-95ee-20245ccf26f3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087462 May 10 20:29:22.032121 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 145/289] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:22.103733 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:22.105739 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:22.110940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:22.111641 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:22.136562 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.137050 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.137852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.138292 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.141471 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.142237 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.143211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.144142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.483382 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:22.494863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ecd470f2-4f3e-4fb0-8771-999b503ce613 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.393934 May 10 20:29:22.495595 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 145/290] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:22 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:22.505603 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:22.515361 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:22.515988 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:22.517719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-677180b8-283e-4a4b-8063-6975c6c906d4 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.406147 May 10 20:29:22.527286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 146/291] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:22 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:22.554968 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.555430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.556233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.556674 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:22.814532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:22.829395 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a30facba-9cad-41b3-92d4-6a7990dc8269 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.331914 May 10 20:29:22.831140 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 146/292] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:22 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:22.957581 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-6e297087-60ee-432e-96ec-29747668c939 req-327f06b6-6f0d-4f45-8a0a-b947fdda1ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2770aa15-1b13-48cc-98e2-125c69098de6", "tag": "e6d53923-3f89-433d-b834-661b0b202dd5"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:22.984495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-6e297087-60ee-432e-96ec-29747668c939 req-327f06b6-6f0d-4f45-8a0a-b947fdda1ada service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:22.985355 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-6e297087-60ee-432e-96ec-29747668c939 req-327f06b6-6f0d-4f45-8a0a-b947fdda1ada service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.003977 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-6e297087-60ee-432e-96ec-29747668c939 req-327f06b6-6f0d-4f45-8a0a-b947fdda1ada service nova] Creating event network-changed:e6d53923-3f89-433d-b834-661b0b202dd5 for instance 2770aa15-1b13-48cc-98e2-125c69098de6 on hv-cinder-82880 May 10 20:29:23.017757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-6e297087-60ee-432e-96ec-29747668c939 req-327f06b6-6f0d-4f45-8a0a-b947fdda1ada service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064356 May 10 20:29:23.019293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 147/293] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:23.514209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:23.514822 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:23.523708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.524371 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.525379 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.527017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.543254 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:23.544208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:23.555381 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.560187 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.562042 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.562504 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.789083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:23.799124 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b0f24cc9-2072-4d03-95ad-165c014a3cee tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1522 microversion: 2.1 time: 0.289268 May 10 20:29:23.810917 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 147/294] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:23 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:23.858364 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:23.862371 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:23.871548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:23.881870 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-dd0bd6ee-34c5-463c-b379-c25fe64a2001 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.346316 May 10 20:29:23.882497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 148/295] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:23 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:23.883447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.884058 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:23.884909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:23.885490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:24.076624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:24.089006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0996a513-90d3-428c-b472-c68f64d2d27c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.244801 May 10 20:29:24.090192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 148/296] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:23 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:24.817251 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:24.818463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:24.830252 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:24.830740 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:24.831686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:24.832006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:24.909107 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:24.910637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:24.924387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:24.926353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:24.929611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:24.930500 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.245405 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:25.253059 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f5651d09-be3b-4f5b-9a63-7df1903258f7 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1315 microversion: 2.1 time: 0.358136 May 10 20:29:25.262122 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 149/297] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:24 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:25.265761 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:25.274777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:25.275681 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:25.279122 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-17a67c86-dfcf-4d8d-a172-e20fee18af33 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1502 microversion: 2.1 time: 0.467123 May 10 20:29:25.280421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 149/298] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:24 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1502 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:25.294626 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.295457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.296480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.297238 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.299330 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:25.306505 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:25.324462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.325056 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.325933 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.327687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.555186 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:25.568390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-077d17da-42f3-4af3-a49a-3e1a6cc7a8c2 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.302529 May 10 20:29:25.571399 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 150/299] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:25 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:25.710377 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-44343ec6-7ff4-439d-9d84-e94c626b6103 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:25.711557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-44343ec6-7ff4-439d-9d84-e94c626b6103 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:25.726793 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-44343ec6-7ff4-439d-9d84-e94c626b6103 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.727780 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-44343ec6-7ff4-439d-9d84-e94c626b6103 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.730552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-44343ec6-7ff4-439d-9d84-e94c626b6103 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:25.733377 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-44343ec6-7ff4-439d-9d84-e94c626b6103 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:25.789974 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-44343ec6-7ff4-439d-9d84-e94c626b6103 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/ips" status: 200 len: 146 microversion: 2.1 time: 0.084818 May 10 20:29:25.791930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 151/300] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:29:25 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/ips => generated 146 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:25.813750 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:25.828605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-94366b5c-552b-4bbf-ab6b-43c48675ce38 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1517 microversion: 2.1 time: 0.533597 May 10 20:29:25.829428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 150/301] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:25 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1517 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:26.278411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:26.279237 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:26.287455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.288394 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.291298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.291996 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.506696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:26.514441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-546c140a-ebda-4162-a22f-f549aea8ba8c tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1464 microversion: 2.1 time: 0.239929 May 10 20:29:26.515024 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 152/302] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:26 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1464 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:26.569424 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:26.570192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:26.576853 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.577587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.585082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.585832 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.588616 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:26.589563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:26.598836 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.601440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.602604 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.604425 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.649772 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:29:26.774346 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-73cc1696-8cd7-44eb-86dd-5f4ad00c7310 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 204 len: 0 microversion: 2.1 time: 0.209333 May 10 20:29:26.775393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 151/303] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:29:26 2022] DELETE /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:29:26.799221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:26.800458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:26.811375 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.812157 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.813353 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:26.814026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:26.819145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:26.828725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e23fa304-e1b3-4257-b100-e7f4cfe1478c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.245429 May 10 20:29:26.840016 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 153/304] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:26 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:26.972696 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:26.981021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-eb59a87f-6b45-449a-8112-1a1b2924e571 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1470 microversion: 2.1 time: 0.199908 May 10 20:29:26.981970 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 152/305] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:26 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1470 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:27.407628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:27.408673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:27.428119 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:27.429611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:27.430629 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:27.431918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:27.488293 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lazy-loading 'flavor' on Instance uuid ffd77532-d88b-4fc0-8ffd-81bc169e55db {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:29:27.596457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-202d99ef-3b92-46ef-812b-2bd2809ad7b2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db/action" status: 200 len: 32 microversion: 2.1 time: 0.195213 May 10 20:29:27.600860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 154/306] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:29:27 2022] POST /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:29:27.609892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:27.610504 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:27.618403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:27.618858 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:27.619643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:27.626076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:27.848402 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:27.850099 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:27.864159 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:27.866668 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:27.869682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:27.871213 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:27.885688 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:27.895979 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6f4af6e4-36e7-4ba4-81e4-1ab1593d2a72 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.289744 May 10 20:29:27.898579 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 153/307] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:27 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:27.999690 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:28.000323 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:28.011009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:28.011461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:28.012237 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:28.012676 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:28.189211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:28.205411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d5e5314c-98b5-43f3-aa4b-fa7b16f383f8 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.362612 May 10 20:29:28.206198 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 155/308] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:27 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:28.247079 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:28.254578 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-597b4fdc-4e40-40f9-9bf2-87d50cbf2eb2 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1470 microversion: 2.1 time: 0.259373 May 10 20:29:28.255692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 154/309] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:27 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1470 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:28.916036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:28.918413 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:28.927671 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:28.928637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:28.929629 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:28.930219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.222090 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:29.222889 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:29.230571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:29.246633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fd5875ce-9bd9-44f8-ae48-bc5f1748d62a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.335433 May 10 20:29:29.247459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.248195 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 156/310] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:28 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:29.248849 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.249931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.250544 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.272612 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:29.273855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:29.286445 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.287335 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.291212 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.291933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.594761 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:29.596630 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:29.605241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0543bd71-886e-4907-8e3a-e0ffab61852e tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1470 microversion: 2.1 time: 0.337360 May 10 20:29:29.607352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 157/311] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:29 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1470 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:29.609112 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2076becc-c720-4709-b103-6f285a2484b4 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.390038 May 10 20:29:29.610934 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 155/312] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:29 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:29.620050 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1874535318", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "networks": [{"uuid": "4cab43d7-cfde-4a61-889f-4f2ce520f079"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:29.732319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] validate_networks() for [('4cab43d7-cfde-4a61-889f-4f2ce520f079', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:29:29.887259 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5f67ffbb-b2fb-4899-98f0-e858d9371e61 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c2aed25-9193-40d2-9ff0-b68cb9ade334"}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:29.889170 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5f67ffbb-b2fb-4899-98f0-e858d9371e61 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:29.899670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5f67ffbb-b2fb-4899-98f0-e858d9371e61 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.900673 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5f67ffbb-b2fb-4899-98f0-e858d9371e61 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:29.902119 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5f67ffbb-b2fb-4899-98f0-e858d9371e61 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:29.902774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5f67ffbb-b2fb-4899-98f0-e858d9371e61 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:30.357589 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5f67ffbb-b2fb-4899-98f0-e858d9371e61 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477377 May 10 20:29:30.385385 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 156/313] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:29:29 2022] POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:30.425753 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:30.430222 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:30.447312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:30.447978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:30.449766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:30.451166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.436185 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:31.441627 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:29:31.443885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:29:31.444641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:29:31.445300 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:29:31.446657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:29:31.448945 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-70001e74-39aa-4712-8008-3e242e0d037a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 1.060126 May 10 20:29:31.449834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 157/314] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:30 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:31.463967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:31.465078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.465742 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.466000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:31.467044 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.467650 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.474910 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.475510 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.476871 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.477701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.529968 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.532246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.533009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lazy-loading 'fault' on Instance uuid e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:29:31.554888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Getting quotas for project f41df963fc334b24b0ddef0946179bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:29:31.563001 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Getting quotas for user 7c4fb8aded0e4f62a7e67e9bd23b81b1 and project f41df963fc334b24b0ddef0946179bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:29:31.622597 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '509c75788fdc46e6aa15096f8a43071c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00d5dc630aa047e2b28547fb11db324f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:31.628561 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:29:31.636516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-74da76b9-9fdd-40bc-9cb8-7d69691f1c75 tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 200 len: 1305 microversion: 2.1 time: 0.185295 May 10 20:29:31.636908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:29:31.639540 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 158/315] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:31 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 1305 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:31.652101 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:31.653396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:31.662156 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.662809 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.663766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.664429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.770981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-da2af91d-d897-42d3-9625-2c61c7e998c5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.162183 May 10 20:29:31.780364 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 158/316] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:29:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:29:31.785272 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-958a89cf-fe47-4cc8-9cdc-16cec484e673 req-acd897bc-95df-422c-bbc8-a1b88cd266a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e6d15d-8fa1-4284-a294-6082bc7fb7d1", "name": "network-vif-deleted", "tag": "26e8a4d3-7676-4091-b213-98ee10e1293a"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:31.808865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-958a89cf-fe47-4cc8-9cdc-16cec484e673 req-acd897bc-95df-422c-bbc8-a1b88cd266a7 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.812052 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-958a89cf-fe47-4cc8-9cdc-16cec484e673 req-acd897bc-95df-422c-bbc8-a1b88cd266a7 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.838224 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-958a89cf-fe47-4cc8-9cdc-16cec484e673 req-acd897bc-95df-422c-bbc8-a1b88cd266a7 service nova] Creating event network-vif-deleted:26e8a4d3-7676-4091-b213-98ee10e1293a for instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 on hv-cinder-82880 May 10 20:29:31.852374 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-958a89cf-fe47-4cc8-9cdc-16cec484e673 req-acd897bc-95df-422c-bbc8-a1b88cd266a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070728 May 10 20:29:31.857430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 159/317] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:31.875034 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9bff993a-23fe-4b2d-a0e6-8064377a0c14 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:31.875621 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9bff993a-23fe-4b2d-a0e6-8064377a0c14 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:31.896771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9bff993a-23fe-4b2d-a0e6-8064377a0c14 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.900902 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9bff993a-23fe-4b2d-a0e6-8064377a0c14 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.904044 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9bff993a-23fe-4b2d-a0e6-8064377a0c14 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:31.904497 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9bff993a-23fe-4b2d-a0e6-8064377a0c14 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:31.960789 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9bff993a-23fe-4b2d-a0e6-8064377a0c14 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/ips" status: 200 len: 153 microversion: 2.20 time: 0.101898 May 10 20:29:31.968179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 160/318] 10.222.0.61 () {60 vars in 1288 bytes} [Tue May 10 20:29:31 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/ips => generated 153 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:29:31.983189 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2d6e3940-465c-457c-a6df-b0dfb55fe9ff tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:31.984529 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2d6e3940-465c-457c-a6df-b0dfb55fe9ff tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:32.069339 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:32.081606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-34dc7613-7e29-4e69-8a1c-c5da4b95d322 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.440799 May 10 20:29:32.082211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 159/319] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:31 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:32.172177 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2d6e3940-465c-457c-a6df-b0dfb55fe9ff tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:32.180324 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2d6e3940-465c-457c-a6df-b0dfb55fe9ff tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1219 microversion: 2.1 time: 0.210863 May 10 20:29:32.184450 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 161/320] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:31 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:32.477187 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:32.479658 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:32.507011 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:32.515938 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:32.519801 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:32.523037 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:32.654855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:32.656047 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] [instance: e3e6d15d-8fa1-4284-a294-6082bc7fb7d1] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:32.670492 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:32.671078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:32.680689 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:32.681280 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:32.711219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] HTTP exception thrown: Instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 could not be found. May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Request method failure captured: May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 HTTP/1.1 May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiessQzo2dQ6RlXtGspkMEVSfr3EyA_e0fe1mssdLVaBSzOFc428Z1md6hHWjQPWtzeAkI25dYWfh3nb_laejS4_UJiLyPEflSwWHnuWNbCK2W0KaNi0J23J6CTJwUP4eiKgYpB6YT-exaKM3ic1_xY7N7aHBbqizvpgBMmeA4Swna9wM May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 00d5dc630aa047e2b28547fb11db324f May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesNegativeTest-661686173 May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:29:32.713236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/00d5dc630aa047e2b28547fb11db324f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/00d5dc630aa047e2b28547fb11db324f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_00d5dc630aa047e2b28547fb11db324f", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/00d5dc630aa047e2b28547fb11db324f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesNegativeTest-661686173 May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 00d5dc630aa047e2b28547fb11db324f May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesNegativeTest-661686173 May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesNegativeTest-661686173-project May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 509c75788fdc46e6aa15096f8a43071c May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesNegativeTest-661686173-project May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 could not be found. May 10 20:29:32.714756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'e3e6d15d-8fa1-4284-a294-6082bc7fb7d1'} May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 could not be found. May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:29:32.715827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 could not be found. May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 could not be found. May 10 20:29:32.717460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:32.718946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] Returning 404 to user: Instance e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:29:32.718946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ee1c2f15-e832-41a5-b2ea-1262cdeb847f tempest-VolumesNegativeTest-661686173 tempest-VolumesNegativeTest-661686173-project] 10.222.0.61 "GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1" status: 404 len: 111 microversion: 2.1 time: 0.067533 May 10 20:29:32.719617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 162/321] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:32 2022] GET /compute/v2.1/servers/e3e6d15d-8fa1-4284-a294-6082bc7fb7d1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:29:33.103872 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:33.104517 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:33.117079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:33.117538 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:33.118730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:33.119186 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:33.121123 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:33.140013 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-843d447a-2196-432f-a5cd-2f7e2c27aba3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.669765 May 10 20:29:33.149738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 160/322] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:32 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:33.202198 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:33.202724 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:33.215001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:33.215749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:33.216588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:33.217046 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:33.374476 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:33.449581 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5e16dd61-5bda-4692-9392-dbf79b190990 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1271 microversion: 2.1 time: 0.216932 May 10 20:29:33.450246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 161/323] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:33 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:33.454914 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:33.467805 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-46a98b01-2aa3-4ae7-91b2-6af7392aa98f tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.371593 May 10 20:29:33.487518 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 163/324] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:33 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:33.935385 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-ade0f24f-0167-45e5-95c4-6372191c2f94 req-b57114da-ef0c-4943-8049-1f25d09309e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2770aa15-1b13-48cc-98e2-125c69098de6", "name": "network-vif-plugged", "status": "completed", "tag": "e6d53923-3f89-433d-b834-661b0b202dd5"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:33.956405 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ade0f24f-0167-45e5-95c4-6372191c2f94 req-b57114da-ef0c-4943-8049-1f25d09309e6 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:33.974300 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ade0f24f-0167-45e5-95c4-6372191c2f94 req-b57114da-ef0c-4943-8049-1f25d09309e6 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.021403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-ade0f24f-0167-45e5-95c4-6372191c2f94 req-b57114da-ef0c-4943-8049-1f25d09309e6 service nova] Creating event network-vif-plugged:e6d53923-3f89-433d-b834-661b0b202dd5 for instance 2770aa15-1b13-48cc-98e2-125c69098de6 on hv-cinder-82880 May 10 20:29:34.041476 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-ade0f24f-0167-45e5-95c4-6372191c2f94 req-b57114da-ef0c-4943-8049-1f25d09309e6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110064 May 10 20:29:34.045978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 162/325] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:34.167724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:34.171558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:34.202719 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.208364 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.215625 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.226841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.321745 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:34.322667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:34.332389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.336994 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.338196 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.338868 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.392689 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lazy-loading 'flavor' on Instance uuid daa24eb7-cd9f-4ca7-bad7-5c275879fecd {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:29:34.560883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:34.576381 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5848e8c4-1b26-4352-91d6-a873a1a43a4e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.420094 May 10 20:29:34.578290 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 164/326] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:34 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:34.595766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:34.600116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:34.618679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.619416 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.622727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.634823 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.835698 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:34.850930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f6acc103-47fd-492e-825f-871b55707cc5 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1277 microversion: 2.1 time: 0.270996 May 10 20:29:34.851508 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 165/327] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:34 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1277 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:34.867381 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:34.876528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:34.908008 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.908476 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:34.914013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:34.914542 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.160024 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7c2c0863-3265-44f1-841b-0572976a661c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/action" status: 202 len: 0 microversion: 2.20 time: 0.844117 May 10 20:29:35.164524 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 163/328] 10.222.0.61 () {62 vars in 1318 bytes} [Tue May 10 20:29:34 2022] POST /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/action => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:29:35.175196 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:35.176574 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:35.187562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.188439 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.189515 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.191513 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.600653 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:35.610880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1673eed7-310a-428b-ab6f-d4590bfcfdf9 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1314 microversion: 2.1 time: 0.751332 May 10 20:29:35.613301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 166/329] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:34 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1314 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:35.634005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:35.635277 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:35.643013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.643738 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.644793 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.645529 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.863081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:35.876633 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:35.883246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:35.885057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1c0ef41d-8f8e-48ff-acf9-8409b009270a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.718294 May 10 20:29:35.891608 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 164/330] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:35 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:35.897201 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:35.901702 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:35.913670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.918319 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:35.919428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:35.920018 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:36.211882 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:36.219322 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-13c61658-e569-4697-9737-c00c1fab6a92 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.597683 May 10 20:29:36.222548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 167/331] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:35 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:36.357943 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:36.368512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-86262bb0-04eb-4667-83ab-e6a4ebb4af35 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.475469 May 10 20:29:36.369286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 165/332] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:35 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:36.477591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-bcf1ad66-66f9-46e8-af37-cf81b66b9885 req-9e04f0d9-7b11-46b4-81b5-c36ed275d413 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d938abee-70d7-4d66-98a6-5479de0392b2", "tag": "a1ca1f69-9459-48f3-a2ba-77bc7ce00384"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:36.488338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-bcf1ad66-66f9-46e8-af37-cf81b66b9885 req-9e04f0d9-7b11-46b4-81b5-c36ed275d413 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:36.489091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-bcf1ad66-66f9-46e8-af37-cf81b66b9885 req-9e04f0d9-7b11-46b4-81b5-c36ed275d413 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:36.515022 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-bcf1ad66-66f9-46e8-af37-cf81b66b9885 req-9e04f0d9-7b11-46b4-81b5-c36ed275d413 service nova] Creating event network-changed:a1ca1f69-9459-48f3-a2ba-77bc7ce00384 for instance d938abee-70d7-4d66-98a6-5479de0392b2 on hv-cinder-82880 May 10 20:29:36.523048 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-bcf1ad66-66f9-46e8-af37-cf81b66b9885 req-9e04f0d9-7b11-46b4-81b5-c36ed275d413 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061119 May 10 20:29:36.523877 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 168/333] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:36.628590 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:36.629448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:36.640441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:36.640905 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:36.643752 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:36.644208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:36.912623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:36.913415 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:36.928796 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:36.929287 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:36.933456 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:36.933916 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:37.093389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:37.102787 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-01d61ea5-08e3-4000-b85b-21c7b8559e41 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1497 microversion: 2.1 time: 0.477142 May 10 20:29:37.103379 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 166/334] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:36 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1497 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:37.242711 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:37.246261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:37.247097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:37.259128 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:37.261877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:37.263804 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:37.265065 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-43c5a760-cc6f-4ee2-abd6-dc30d15f70ca tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.358538 May 10 20:29:37.266360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:37.267228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:37.267826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:37.270989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 169/335] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:36 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:37.385732 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:37.386356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:37.398696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:37.399160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:37.399969 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:37.405805 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.062480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:38.082214 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a39c2cc8-1bae-4c6f-adcd-1794333696a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.846999 May 10 20:29:38.092379 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:38.094464 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 167/336] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:37 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:38.110357 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9fc340f0-ee07-43db-8cf2-8c3cb0db09cd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.726254 May 10 20:29:38.111013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 170/337] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:37 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:38.162474 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:38.162967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:38.185665 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.186286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.188571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.189062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.244514 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:29:38.292493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:38.293162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:38.313815 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.317319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.318665 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.319342 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.400784 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-593a0a3d-d864-4f98-b200-35019123fd66 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 204 len: 0 microversion: 2.1 time: 0.241909 May 10 20:29:38.404031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 168/338] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:29:38 2022] DELETE /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:29:38.419899 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:38.424690 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:38.433261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.433950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.434938 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.435579 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.681758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:38.690415 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:38.692002 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:38.693209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-35204725-d642-4c77-a016-99b5ece91f5c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.404991 May 10 20:29:38.695136 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:38.700716 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 171/339] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:38 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:29:38.704037 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4c0b8c63-a730-4c74-9d8c-ec9ce9527eba tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1503 microversion: 2.1 time: 0.294063 May 10 20:29:38.705248 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 169/340] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:38 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1503 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:38.708689 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8de3cdd9-672c-45c5-8582-f5089cdc0f9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:38.717696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8de3cdd9-672c-45c5-8582-f5089cdc0f9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.718160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8de3cdd9-672c-45c5-8582-f5089cdc0f9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.785704 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8de3cdd9-672c-45c5-8582-f5089cdc0f9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Going to try to stop instance {{(pid=117261) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 20:29:38.855278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8de3cdd9-672c-45c5-8582-f5089cdc0f9c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action" status: 202 len: 0 microversion: 2.1 time: 0.151914 May 10 20:29:38.855882 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 172/341] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:29:38 2022] POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:29:38.864228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:38.864901 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:38.871396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.871851 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:38.872643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:38.873155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.026826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:39.052191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-628e01f5-461d-44ee-8b87-57ada07a49ba tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.192011 May 10 20:29:39.052787 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 170/342] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:38 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:39.102562 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:39.103890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:39.110212 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.110861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.111858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.112487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.128021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:39.128759 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:39.136397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.141897 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.143784 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.144234 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.391186 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:39.399725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-19464065-ec53-48d6-8beb-6a42657350fe tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.301596 May 10 20:29:39.400318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 173/343] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:39 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:39.507995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:39.516142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0303cc48-6009-4a0b-b031-d1d4ab34dcad tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.392338 May 10 20:29:39.528601 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 171/344] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:39 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:39.718757 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:39.719826 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:39.726949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:39.733045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:39.737349 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.737818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.738494 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.738990 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.753692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.755017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:39.756053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:39.761863 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.097821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:40.132725 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:40.143704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ca94c283-802c-4e95-afca-34a6d4339e7c tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1503 microversion: 2.1 time: 0.420924 May 10 20:29:40.149542 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 172/345] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:39 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1503 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:40.154950 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:40.159643 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:40.162216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-80965313-a6fd-45e5-80a0-5271c5786d11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.454189 May 10 20:29:40.163589 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 174/346] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:39 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:40.166916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:40.167546 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:40.178389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.178849 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.179645 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.180094 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.418355 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:40.419123 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:40.436873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.437473 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.442672 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.443656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.499190 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:40.513834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c857b3e6-6b39-4762-a401-f6fabf2fe294 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.360183 May 10 20:29:40.516013 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 173/347] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:40 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:40.540963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:40.541972 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:40.575367 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.576337 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.577262 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:40.577750 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:40.899279 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:40.917773 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5b7a6b41-e3c4-408b-b9fb-12979db165e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.504876 May 10 20:29:40.923026 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 175/348] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:40 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:41.167085 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:41.168519 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:41.184754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.185536 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.187062 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.188905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.226263 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:41.234685 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7a3936d4-0684-4077-9501-8d9832442a43 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.702862 May 10 20:29:41.242609 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 174/349] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:40 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:41.249736 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:41.251897 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:41.275205 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.277683 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.280373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.283907 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.690939 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:41.695411 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:41.712136 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d645946a-c348-4ad8-9f3a-baaa984e5c50 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1503 microversion: 2.1 time: 0.550009 May 10 20:29:41.715859 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:41.722787 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:41.725491 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 176/350] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:41 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1503 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:41.730494 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:41.734022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2375dd6f-4a6a-4a67-b525-b4f41ac2f2e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.487138 May 10 20:29:41.736928 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 175/351] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:41 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:41.738676 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:41.751475 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.753684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.758130 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.758822 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.772469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-ad4c52ae-648b-4d26-8164-1d762f0a4a7c req-5b942bca-1dda-4f3e-9b7e-89e11296b067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2770aa15-1b13-48cc-98e2-125c69098de6", "name": "network-vif-deleted", "tag": "e6d53923-3f89-433d-b834-661b0b202dd5"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:41.788831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ad4c52ae-648b-4d26-8164-1d762f0a4a7c req-5b942bca-1dda-4f3e-9b7e-89e11296b067 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.789296 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ad4c52ae-648b-4d26-8164-1d762f0a4a7c req-5b942bca-1dda-4f3e-9b7e-89e11296b067 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:41.826200 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-ad4c52ae-648b-4d26-8164-1d762f0a4a7c req-5b942bca-1dda-4f3e-9b7e-89e11296b067 service nova] Creating event network-vif-deleted:e6d53923-3f89-433d-b834-661b0b202dd5 for instance 2770aa15-1b13-48cc-98e2-125c69098de6 on hv-cinder-82880 May 10 20:29:41.834771 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-ad4c52ae-648b-4d26-8164-1d762f0a4a7c req-5b942bca-1dda-4f3e-9b7e-89e11296b067 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065596 May 10 20:29:41.839981 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 176/352] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:41.945385 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:41.957933 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:41.998367 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:41.999262 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.001182 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.006098 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.081376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:42.098661 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ffffa182-c12d-460f-90da-4c497741d1d8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.371760 May 10 20:29:42.099791 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 177/353] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:41 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:42.269753 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:42.270460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:42.286568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.287030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.287835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.288278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.367107 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:42.381506 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-59abf702-f600-440f-b659-bc1b0c4202fb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.445769 May 10 20:29:42.393398 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 177/354] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:41 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:42.583379 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:42.621447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1f71162e-7069-464e-86c5-7c88f4343090 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.354986 May 10 20:29:42.635165 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 178/355] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:42 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:42.736341 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:42.737300 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:42.745967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.746768 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.753528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:42.754717 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:42.759826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.760729 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.766414 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.767218 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.778930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.779484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.846855 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:42.847881 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:42.850848 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lazy-loading 'fault' on Instance uuid 2770aa15-1b13-48cc-98e2-125c69098de6 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:29:42.977274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '968e45f60cb74bd9b16b2c74801071fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a24528148d9444038c71b83c90aa026e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:42.985013 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-590520d8-acfa-4221-a7b1-f9da2b972658 tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 200 len: 1304 microversion: 2.1 time: 0.252822 May 10 20:29:42.995261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 178/356] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:42 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 1304 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:43.082378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:43.096321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:43.098444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:43.100368 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0f8eb3eb-b5bf-4f97-89f5-5748de5782b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.351372 May 10 20:29:43.111603 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 179/357] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:42 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:43.117261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:43.118110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:43.132757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.133253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.134044 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.134540 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.306663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:43.315571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-dc5ffaad-c94a-4efe-bb51-79fef88851df tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.202590 May 10 20:29:43.322663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 179/358] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:43 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:43.401485 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:43.402959 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:43.417527 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.418472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.419296 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.419737 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.638834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:43.640860 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:43.663189 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.679040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.679955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.680419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.750985 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:43.768173 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-559989cc-c11f-40fc-8756-b87de1e7eba6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.372929 May 10 20:29:43.769509 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 180/359] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:43 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:43.790164 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-29b5920d-cb4d-40ac-a1e8-1ce5706b604b req-98d8e167-72eb-4315-8554-e0e76ed6d57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d938abee-70d7-4d66-98a6-5479de0392b2", "name": "network-vif-plugged", "status": "completed", "tag": "a1ca1f69-9459-48f3-a2ba-77bc7ce00384"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:43.808597 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-29b5920d-cb4d-40ac-a1e8-1ce5706b604b req-98d8e167-72eb-4315-8554-e0e76ed6d57e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:43.809395 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-29b5920d-cb4d-40ac-a1e8-1ce5706b604b req-98d8e167-72eb-4315-8554-e0e76ed6d57e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:43.830769 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-29b5920d-cb4d-40ac-a1e8-1ce5706b604b req-98d8e167-72eb-4315-8554-e0e76ed6d57e service nova] Creating event network-vif-plugged:a1ca1f69-9459-48f3-a2ba-77bc7ce00384 for instance d938abee-70d7-4d66-98a6-5479de0392b2 on hv-cinder-82880 May 10 20:29:43.841266 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-29b5920d-cb4d-40ac-a1e8-1ce5706b604b req-98d8e167-72eb-4315-8554-e0e76ed6d57e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058109 May 10 20:29:43.842099 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 181/360] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:43.984868 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:44.007424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:44.007424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] [instance: 2770aa15-1b13-48cc-98e2-125c69098de6] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:44.019259 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.020608 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.021573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c958dc46-4090-4e90-b314-f52a82981bbe tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.383595 May 10 20:29:44.022456 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.023275 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 180/361] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:43 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:44.031979 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.048864 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] HTTP exception thrown: Instance 2770aa15-1b13-48cc-98e2-125c69098de6 could not be found. May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Request method failure captured: May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 HTTP/1.1 May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiessF6o4hiJUSORKPVdTSYeU5rHz9wqSHiMdcOkOuMOPmV5Fv9DAzLJYESCDxJ5JHGO-g7lYD8RMoIBDYkJgRmebsheJmNvNvEoJjCKX9ANgnX6AV-mEyDrkE0ECCvojV5NgMvjM3EQLortLIFKm_YWRb7wNA5CGDg42CVtD36wII1bA May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: a24528148d9444038c71b83c90aa026e May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesActionsTest-580968936 May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:29:44.050868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a24528148d9444038c71b83c90aa026e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a24528148d9444038c71b83c90aa026e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a24528148d9444038c71b83c90aa026e", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a24528148d9444038c71b83c90aa026e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesActionsTest-580968936 May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: a24528148d9444038c71b83c90aa026e May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesActionsTest-580968936 May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesActionsTest-580968936-project May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 968e45f60cb74bd9b16b2c74801071fb May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesActionsTest-580968936-project May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 2770aa15-1b13-48cc-98e2-125c69098de6 could not be found. May 10 20:29:44.053015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '2770aa15-1b13-48cc-98e2-125c69098de6'} May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2770aa15-1b13-48cc-98e2-125c69098de6 could not be found. May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:29:44.053991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2770aa15-1b13-48cc-98e2-125c69098de6 could not be found. May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2770aa15-1b13-48cc-98e2-125c69098de6 could not be found. May 10 20:29:44.055747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:29:44.065164 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] Returning 404 to user: Instance 2770aa15-1b13-48cc-98e2-125c69098de6 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:29:44.066819 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fb1bcd3a-c83f-44c0-a0c7-b919a0481d1a tempest-VolumesActionsTest-580968936 tempest-VolumesActionsTest-580968936-project] 10.222.0.61 "GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6" status: 404 len: 111 microversion: 2.1 time: 0.067409 May 10 20:29:44.069017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 182/362] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:43 2022] GET /compute/v2.1/servers/2770aa15-1b13-48cc-98e2-125c69098de6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:29:44.122751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:44.123442 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:44.134014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.134462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.135706 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.136407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.337521 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:44.356758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:44.385818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.387435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.390270 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.392339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.454150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:44.481132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:44.483110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:44.484572 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f9070e3d-ba9f-4ae7-96c6-a7692024bf53 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.369044 May 10 20:29:44.485760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 181/363] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:44 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:44.765231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:44.790583 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d6e8b24f-d9a9-4c7d-9915-faa2b6a40c64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.460062 May 10 20:29:44.792294 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:44.793316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:44.808027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 183/364] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:44 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:44.808486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.809052 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:44.809875 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:44.810346 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.048102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:45.054307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:45.078102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.078102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.078102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.078102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.093536 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.104239 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3a850c45-2036-45e7-9422-0782aaf07358 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1503 microversion: 2.1 time: 0.318895 May 10 20:29:45.105890 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 182/365] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:44 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:45.124135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f8fb5a4-6d93-499f-84d9-c4f1e966f970"}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:45.126212 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:45.137362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.138157 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.139910 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.141529 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.175402 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] HTTP exception thrown: Cannot 'attach_volume' instance ffd77532-d88b-4fc0-8ffd-81bc169e55db while it is in vm_state rescued May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Request method failure captured: May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: POST /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db/os-volume_attachments HTTP/1.1 May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 74 May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesq0Vc_JFx25RDdGrab6G1Iqu_JtPPyOBfXB8fkoV9jcyK650upwuLU5hG6oDEdqSuuvbiquU2zsKAUQg3ZRDYCridJB_yYopyk0JTkLq68JtvfMdR6Gly2BpmcpOsEo14_p6IHGfWiEfacS-oEsbkwH3bvVn6fY4ezHZcjBsuf-y7g May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:29:45.178048 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67dae2f388bc4a81bc957f48b1b02e42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: df3cf8a2f7c54b80aac61d6ca59672b5 May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {"volumeAttachment": {"volumeId": "4f8fb5a4-6d93-499f-84d9-c4f1e966f970"}} May 10 20:29:45.179468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Cannot 'attach_volume' instance ffd77532-d88b-4fc0-8ffd-81bc169e55db while it is in vm_state rescued May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'server_id': 'ffd77532-d88b-4fc0-8ffd-81bc169e55db', 'body': {'volumeAttachment': {'volumeId': '4f8fb5a4-6d93-499f-84d9-c4f1e966f970'}}} May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ffd77532-d88b-4fc0-8ffd-81bc169e55db in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:29:45.180172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ffd77532-d88b-4fc0-8ffd-81bc169e55db while it is in vm_state rescued May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:29:45.181378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:29:45.182448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:29:45.182448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:29:45.182448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ffd77532-d88b-4fc0-8ffd-81bc169e55db while it is in vm_state rescued May 10 20:29:45.182448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:29:45.182448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Returning 409 to user: Cannot 'attach_volume' instance ffd77532-d88b-4fc0-8ffd-81bc169e55db while it is in vm_state rescued {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:29:45.182448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3c382eae-05e6-4432-9177-f92691988076 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061472 May 10 20:29:45.185092 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 183/366] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:29:45 2022] POST /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db/os-volume_attachments => generated 152 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 20:29:45.189883 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-16e2e1ef-6ae2-4ca0-9f6d-4a64770c136b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:45.190420 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-16e2e1ef-6ae2-4ca0-9f6d-4a64770c136b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:45.197704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e2e1ef-6ae2-4ca0-9f6d-4a64770c136b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.198491 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e2e1ef-6ae2-4ca0-9f6d-4a64770c136b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.199297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e2e1ef-6ae2-4ca0-9f6d-4a64770c136b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.200023 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e2e1ef-6ae2-4ca0-9f6d-4a64770c136b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.274275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.284389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a64734d5-402b-4a0c-9a02-6617c9172238 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.245881 May 10 20:29:45.288751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-16e2e1ef-6ae2-4ca0-9f6d-4a64770c136b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db/action" status: 202 len: 0 microversion: 2.1 time: 0.102392 May 10 20:29:45.289938 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 184/367] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:29:45 2022] POST /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:29:45.295069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 184/368] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:45 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:45.310211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:45.310908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:45.322249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.322712 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.324321 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.325350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.503534 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:45.504098 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:45.515583 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.516110 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.516939 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.517413 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.540298 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.551675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9b3b9b37-26ad-4eae-85b5-fc03afd904f7 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1511 microversion: 2.1 time: 0.248461 May 10 20:29:45.552628 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 185/369] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:45 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1511 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:45.689650 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.706636 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.709410 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.711095 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2fd3f695-7229-461d-af8f-a7575c27ecc5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.211033 May 10 20:29:45.711696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 185/370] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:45 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:45.813986 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:45.814603 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:45.825224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.825622 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.826417 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:45.826861 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:45.974599 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:45.982614 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fd29fde8-9c5a-4081-9d93-2e036dc9b899 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.172426 May 10 20:29:45.983182 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 186/371] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:45 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:46.302094 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:46.303301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:46.310585 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.311256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.312224 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.312899 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.466148 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:46.473980 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7b0617bd-69ce-4502-88e7-cb8b5c84310a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.175764 May 10 20:29:46.474553 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 186/372] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:46 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:46.570305 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:46.570999 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:46.579928 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.580704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.581718 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.582357 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.729412 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:46.730418 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:46.733433 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:46.737700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.738154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.739484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:46.740026 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:46.745066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a05fc303-14b6-4a55-ae48-204fc3db97d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1511 microversion: 2.1 time: 0.179117 May 10 20:29:46.746199 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 187/373] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:46 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:46.898303 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:46.911338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:46.912960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:46.914390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-df80bc78-8a6a-423d-8c6a-24d71ddd2e36 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.188867 May 10 20:29:46.915463 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 187/374] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:46 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:46.999552 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:47.000155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:47.007012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.007459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.008224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.008818 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.165287 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:47.174023 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5d9cc789-f176-48e1-9a64-2effcaada5c2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.178200 May 10 20:29:47.183951 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 188/375] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:46 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:47.491057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:47.491739 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:47.498130 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.498593 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.499384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.499829 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.648524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:47.655299 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-894f5b26-f10e-434e-b76e-6577b592cd53 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.168291 May 10 20:29:47.655937 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 188/376] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:47 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:47.763278 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:47.763928 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:47.771055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.771521 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.772570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.773031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.932351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:47.936522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:47.937164 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:47.940957 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ac68cab5-b3aa-4545-b44d-01c44c30838f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1511 microversion: 2.1 time: 0.181674 May 10 20:29:47.942518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 189/377] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:47 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:47.944710 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.945308 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:47.946336 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:47.946968 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.108854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:48.116721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:48.118460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:48.119619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f2680def-3f10-456b-9459-bb997f75d500 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.186908 May 10 20:29:48.120179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 189/378] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:47 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:29:48.191532 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:48.193372 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:48.199803 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.200244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.201084 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.201719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.369518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:48.378661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-577b2c73-1329-4edc-bfe8-a93e1cf2f845 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.190943 May 10 20:29:48.379309 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 190/379] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:48 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:48.734789 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:48.735494 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:48.742718 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.743179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.744037 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.744648 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.884493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:48.892765 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fff5eada-179d-49d8-ac67-85a63bd62271 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1319 microversion: 2.1 time: 0.164962 May 10 20:29:48.893675 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 190/380] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:48 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:48.960127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:48.960847 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:48.967892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.969171 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:48.970322 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:48.970998 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:49.137471 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:49.138116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:49.154204 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.169362 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:49.171206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.171821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:49.292355 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:49.309175 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-75e7bed2-748d-4aed-a555-283a7cf2f9d9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1511 microversion: 2.1 time: 0.352730 May 10 20:29:49.325928 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 191/381] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:48 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1511 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:49.390814 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:49.396311 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:49.397230 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:49.402622 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:49.404568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:49.407134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e19c1a55-ddae-47f7-8c86-2a905f1748a1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.273651 May 10 20:29:49.408263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 191/382] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:49 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:49.412400 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.413197 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:49.414338 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.415328 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:49.675176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:49.684108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-11f59f87-1478-4544-8865-98d82c67ccbb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.292280 May 10 20:29:49.688577 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 192/383] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:49 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:49.911113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:49.912484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:49.922438 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.923380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:49.924438 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:49.925087 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.182877 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:50.191006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5aab1618-7c99-4858-ad7e-cea8f77b686e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1509 microversion: 2.1 time: 0.284904 May 10 20:29:50.192862 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 192/384] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:49 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:50.331314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:50.334157 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:50.344582 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:50.350080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.351173 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:50.351629 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.433884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:50.435077 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:50.460130 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:50.460965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.467759 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:50.468747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.870278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:50.880771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:50.882700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:50.884468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-548811f5-ee05-4ded-96c4-b34ac156d0f4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.461884 May 10 20:29:50.896453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 193/385] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:50 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:50.901946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:50.902365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:50.903183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:50.912777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:50.914070 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.915119 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:50.915743 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cce791e3-a6fe-40c0-8bdf-3fe0d141992b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1511 microversion: 2.1 time: 0.584440 May 10 20:29:50.916003 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:50.916351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 193/386] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:50 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:51.095808 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:51.108327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-392bcef7-a447-416a-867d-3989600cdb1c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.210051 May 10 20:29:51.109981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 194/387] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:50 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:51.903929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:51.905531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:51.916920 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:51.917667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:51.918886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:51.919478 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:51.933289 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:51.934593 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:51.978222 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:51.979613 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:51.982062 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:51.982750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:52.355046 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:52.363017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:52.364566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:52.370547 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e5378548-1cae-48d4-a4a3-20ce284d71d6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1746 microversion: 2.20 time: 0.470931 May 10 20:29:52.371347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 194/388] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:51 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1746 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:52.383336 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:52.385565 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:52.389387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:52.398410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:52.400993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f267b007-2db9-4922-a063-34dff69bee53 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1517 microversion: 2.1 time: 0.469059 May 10 20:29:52.401408 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:52.402272 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:52.402871 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:52.423761 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 195/389] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:51 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1517 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:52.423761 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3d5c883d-4bea-4a7d-8387-d6a7b07232c8 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Action: 'create', calling method: .version_select at 0x7fb2734c7e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-84461549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2vyOsf0wNO/RPQz0ydytsZ99nOgqBBhn24TX5vCkR0dhwbp0j65m83CG5pRo41Cnysr5NJ4uI+FyAuH72gLsUkCCyNYRBZJ2Ftcez4LGBuJGqScj8hK+WTK+yByRv2cw=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:52.438010 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-3d5c883d-4bea-4a7d-8387-d6a7b07232c8 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Getting quotas for project 51884a66cf014d6596d22c37c4a97147. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:29:52.470387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-3d5c883d-4bea-4a7d-8387-d6a7b07232c8 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Getting quotas for user 50d5a87e4d094287bb543721c9c9909d and project 51884a66cf014d6596d22c37c4a97147. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:29:52.552521 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3d5c883d-4bea-4a7d-8387-d6a7b07232c8 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.137615 May 10 20:29:52.553796 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 196/390] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:29:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:52.746569 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:52.753345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-259934072", "imageRef": "2aec5e56-68f4-4746-a307-493628bbba25", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-84461549", "networks": [{"uuid": "4369b197-1a56-465e-9984-92729f634dd2"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:52.761813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-41e2f8dc-2a9d-4aaa-8fcf-5b7db582af26 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.383314 May 10 20:29:52.762394 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 195/391] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:52 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:52.922089 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] validate_networks() for [('4369b197-1a56-465e-9984-92729f634dd2', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:29:53.390987 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:53.392141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:53.415796 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.416241 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:53.417601 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.418149 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:53.439092 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:29:53.439599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:29:53.439975 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:29:53.440381 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:29:53.440790 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:29:53.453133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.453592 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:53.454931 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.455384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:53.481737 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Getting quotas for project 51884a66cf014d6596d22c37c4a97147. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:29:53.486716 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Getting quotas for user 50d5a87e4d094287bb543721c9c9909d and project 51884a66cf014d6596d22c37c4a97147. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:29:53.499125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:29:53.501650 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2aec5e56-68f4-4746-a307-493628bbba25',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:29:53.571438 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-316fa60c-973c-48ae-b359-a9e224b1aff7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841344 May 10 20:29:53.572376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 197/392] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:29:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:29:53.595396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fb78ef75-c127-4bed-a8af-45efb0f80f27 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:53.596663 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fb78ef75-c127-4bed-a8af-45efb0f80f27 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:53.661951 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:53.674934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fb78ef75-c127-4bed-a8af-45efb0f80f27 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:53.683401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fb78ef75-c127-4bed-a8af-45efb0f80f27 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1256 microversion: 2.1 time: 0.099758 May 10 20:29:53.684814 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 198/393] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:53 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1256 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:53.693121 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:53.696825 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:53.698707 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-55ffc486-9024-4b84-aac4-b203da9f1733 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1746 microversion: 2.20 time: 0.311759 May 10 20:29:53.707006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 196/394] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:53 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1746 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:29:53.779599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:53.780735 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:53.806019 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.806497 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:53.807394 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:53.807848 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:54.096007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ac1b119f-4675-4d16-b640-b21546b857a9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'create', calling method: .version_select at 0x7fb2785788b0>, body: {"keypair": {"name": "tempest-keypair-1620750835", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2gNKhLJZMvNdv3lFDWOsCPlvE2c+0PKnOM/B2tYNCsEt9YVXh83FTrlA76b7Dd8fBljNGMu6Nr5uoWMjc+gQEpfmWonMqOdmB3ye65KPnutFybV2XhM0hCR2ye/JEpFw=="}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:54.107970 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:54.122302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-ac1b119f-4675-4d16-b640-b21546b857a9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:29:54.126809 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-484c6a7c-f88b-4fde-a561-aa88640a8d86 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.351499 May 10 20:29:54.130446 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 199/395] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:53 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:54.131948 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-ac1b119f-4675-4d16-b640-b21546b857a9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for user df3cf8a2f7c54b80aac61d6ca59672b5 and project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:29:54.212000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ac1b119f-4675-4d16-b640-b21546b857a9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.121500 May 10 20:29:54.213288 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 197/396] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:29:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:29:54.702580 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:54.704437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:54.712535 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:54.713360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:54.715101 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:54.716363 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:54.728050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:54.729596 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:54.738980 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:54.739418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:54.741667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:54.748127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:55.152771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:55.161331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0a653170-2a34-4b5f-9dc3-524e893db538 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1308 microversion: 2.1 time: 0.463621 May 10 20:29:55.162532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 200/397] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:54 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:55.167488 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:55.168291 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:55.174259 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:55.175169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:55.176474 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:55.177251 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:55.415234 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:55.424940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:55.429062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:55.430834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-59fdf996-c8da-4711-94de-c156019337fe tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1746 microversion: 2.20 time: 0.709669 May 10 20:29:55.432675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 198/398] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:54 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1746 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:55.467096 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:55.476641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-11d12708-8add-4309-9902-b9d3d907cac7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.312839 May 10 20:29:55.479215 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 201/399] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:55 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:55.749410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-79dabfc3-0d5c-4a66-a7ad-ef82ec547a8b req-0df1f0e1-8f5d-4c62-a4e8-e7e43a7577e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa24eb7-cd9f-4ca7-bad7-5c275879fecd", "name": "network-vif-plugged", "status": "completed", "tag": "d8fb0937-0365-4e3b-b493-e0343c1b6efa"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:55.767861 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-79dabfc3-0d5c-4a66-a7ad-ef82ec547a8b req-0df1f0e1-8f5d-4c62-a4e8-e7e43a7577e1 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:55.769365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-79dabfc3-0d5c-4a66-a7ad-ef82ec547a8b req-0df1f0e1-8f5d-4c62-a4e8-e7e43a7577e1 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:55.795730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-79dabfc3-0d5c-4a66-a7ad-ef82ec547a8b req-0df1f0e1-8f5d-4c62-a4e8-e7e43a7577e1 service nova] Creating event network-vif-plugged:d8fb0937-0365-4e3b-b493-e0343c1b6efa for instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd on hv-cinder-82880 May 10 20:29:55.811978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-79dabfc3-0d5c-4a66-a7ad-ef82ec547a8b req-0df1f0e1-8f5d-4c62-a4e8-e7e43a7577e1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066891 May 10 20:29:55.813108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 199/400] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:56.178873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:56.179400 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:56.188461 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.192229 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.194429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.195094 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.451711 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:56.452331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:56.470445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.471302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.472267 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.472894 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.532537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:56.549482 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-712743b1-28b4-4515-9aed-b0ea5fafdb86 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.374804 May 10 20:29:56.550453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 202/401] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:56 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:56.562061 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:56.563184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:56.594998 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.595804 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.599444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:56.601618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:56.794695 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:56.815256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:56.818349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:56.819894 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e21d4ed4-0a37-4b14-912b-43b7f5652dd0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.374137 May 10 20:29:56.820902 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 200/402] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:56 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:56.837379 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-795533015", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a39b073b-dc0a-4098-8dbd-0428d76eaadb"}], "security_groups": [{"name": "tempest-securitygroup--1003595493"}], "key_name": "tempest-keypair-1620750835", "user_data": "}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:56.876551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:56.885489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-029fed46-47b5-478b-88b0-7adbe6febf0b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.333117 May 10 20:29:56.886699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 203/403] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:56 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:57.221318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-50ddeba2-dd8e-4796-9e6c-039f9d89bb9c req-cf7e7f87-10f3-4df1-bf0b-b95475e41c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6131f4a-2a40-4b33-bf35-763bb6dbf01c", "tag": "17b60462-c5b3-4701-9d7d-de886673ef7d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:29:57.235751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-50ddeba2-dd8e-4796-9e6c-039f9d89bb9c req-cf7e7f87-10f3-4df1-bf0b-b95475e41c4a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:57.236426 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-50ddeba2-dd8e-4796-9e6c-039f9d89bb9c req-cf7e7f87-10f3-4df1-bf0b-b95475e41c4a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:57.267981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-50ddeba2-dd8e-4796-9e6c-039f9d89bb9c req-cf7e7f87-10f3-4df1-bf0b-b95475e41c4a service nova] Creating event network-changed:17b60462-c5b3-4701-9d7d-de886673ef7d for instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c on hv-cinder-82880 May 10 20:29:57.276449 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-50ddeba2-dd8e-4796-9e6c-039f9d89bb9c req-cf7e7f87-10f3-4df1-bf0b-b95475e41c4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059244 May 10 20:29:57.281155 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 204/404] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:29:57.571701 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:57.572418 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:57.579483 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:57.580134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:57.581544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:57.582724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:57.759918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:57.768373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bc5e3cf3-16d0-4ce2-8f37-0ad94f19c229 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.203748 May 10 20:29:57.777958 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 205/405] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:57 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:57.838926 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:57.839465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:57.846316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:57.847074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:57.848604 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:57.849091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:58.013699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:58.023580 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:58.025166 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:58.026461 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0922e44e-10ae-40d6-9d68-085c9b4a097c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.191477 May 10 20:29:58.027341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 206/406] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:57 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:29:58.032079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:58.032724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:58.047529 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:58.049648 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:58.052885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:58.053951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:58.229722 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:58.254063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e0cce5cb-0ece-4225-8b3e-4ad376462923 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.225540 May 10 20:29:58.254762 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 207/407] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:58 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:29:58.787981 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:58.788936 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:58.796773 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:58.797359 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:58.798164 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:58.798617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:58.943854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:58.952467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c04ac293-62d6-4db6-9288-913c28985b9d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.169314 May 10 20:29:58.953356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 208/408] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:58 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:59.045637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:59.046343 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:59.053445 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.054125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:59.054939 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.055540 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:59.204940 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:59.216354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:59.217996 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:59.219799 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bbdd5f0c-abeb-47f9-b633-f7104d12eb9f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.178149 May 10 20:29:59.231169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 209/409] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:29:59 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:29:59.273610 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:59.274248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:59.281051 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.281738 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:59.282555 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.283182 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:59.429627 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:29:59.439952 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-478bad94-6a33-46c5-a950-ef2a0b8a8802 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.171107 May 10 20:29:59.440621 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 210/410] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:59 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:29:59.970075 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:29:59.971023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:29:59.977691 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.978223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:29:59.979108 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:29:59.979617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:00.120464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:00.131758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0e31dcb8-02b8-4bab-b669-7ab8ad3f9aea tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.165484 May 10 20:30:00.133717 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 211/411] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:29:59 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:00.238635 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:00.239268 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:00.245435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:00.245894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:00.246701 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:00.247145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:00.400321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:00.410349 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:00.412057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:00.413353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-23ea248a-d335-440d-af6d-ef18bbccdc0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.179296 May 10 20:30:00.414058 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 212/412] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:00 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:00.458427 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:00.459251 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:00.466721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:00.467184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:00.468116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:00.468566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:00.611138 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:00.622271 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-41672908-9e2e-4f2d-861c-9a5cc7c4a00f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1725 microversion: 2.1 time: 0.167802 May 10 20:30:00.622865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 213/413] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:00 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:01.150940 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:01.152088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:01.158409 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.158862 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.159800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.160785 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.305887 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:01.313633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f26603c1-d507-490c-8115-1253dbc45433 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.167376 May 10 20:30:01.314203 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 214/414] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:01 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:01.437672 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:01.438618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:01.448112 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.450783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.451798 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.452449 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.602613 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:01.610986 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:01.612659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:01.614059 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bae93d64-b31b-4ea9-948c-be0108d6e87c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.180370 May 10 20:30:01.614708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 215/415] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:01 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:01.649783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:01.650423 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:01.656942 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.657599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.658408 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.658844 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.803999 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:01.811820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-27e6169c-dd99-4b33-a63e-af0d97c4cc4f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1702 microversion: 2.1 time: 0.166239 May 10 20:30:01.812396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 216/416] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:01 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1702 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:01.829051 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-de8df275-c7e8-425c-8537-8718daf0f3d1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:01.835330 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-de8df275-c7e8-425c-8537-8718daf0f3d1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.835817 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-de8df275-c7e8-425c-8537-8718daf0f3d1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.859250 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-de8df275-c7e8-425c-8537-8718daf0f3d1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Going to try to start instance {{(pid=117261) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 20:30:01.912221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-de8df275-c7e8-425c-8537-8718daf0f3d1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action" status: 202 len: 0 microversion: 2.1 time: 0.086899 May 10 20:30:01.915771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 217/417] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:30:01 2022] POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:30:01.921727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:01.922453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:01.929885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.930375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:01.931217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:01.931638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:02.154208 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:02.162341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-20665ff0-ae34-46fb-ba69-193f689ff7ea tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1711 microversion: 2.1 time: 0.245125 May 10 20:30:02.162934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 218/418] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:01 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1711 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:02.331567 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:02.332279 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:02.339271 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:02.339766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:02.340569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:02.342299 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:02.496255 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:02.504274 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-045070eb-6cdb-4f1a-a48f-c733dc1e6496 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.176776 May 10 20:30:02.514064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 219/419] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:02 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:02.633681 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:02.635281 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:02.652441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:02.652441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:02.652441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:02.652441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:02.792088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:02.801375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:02.802937 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:02.804136 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d6f3a9ef-56fe-424d-a2ce-17d4292b7a50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.176157 May 10 20:30:02.814472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 220/420] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:02 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:03.181842 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:03.182551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:03.188643 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:03.189144 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:03.189937 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:03.190406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:03.328672 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:03.337810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f4641c70-040a-422d-964b-bb0b89fdac17 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1711 microversion: 2.1 time: 0.159877 May 10 20:30:03.338571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 221/421] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:03 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1711 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:03.521932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:03.522780 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:03.542709 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:03.543175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:03.543977 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:03.544422 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:03.705589 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:03.719460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-aa9074ae-d413-4df2-8a34-688db04832b0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.201667 May 10 20:30:03.720374 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 222/422] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:03 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:03.822335 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:03.823188 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:03.829279 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:03.829728 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:03.830491 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:03.830924 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:03.964255 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:03.973332 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:03.974853 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:03.976035 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-773b66cc-7442-4036-b680-6f84656b8b0a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.157711 May 10 20:30:03.976591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 223/423] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:03 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:04.357704 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:04.358462 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:04.369859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:04.370321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:04.371157 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:04.371600 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:04.515487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:04.525727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e746e190-9b32-4976-bb74-c86fb231af70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1715 microversion: 2.1 time: 0.173298 May 10 20:30:04.526298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 224/424] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:04 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1715 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:04.737654 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:04.738852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:04.745467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:04.745957 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:04.746821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:04.747254 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:04.888022 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:04.896374 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-59d1493d-1357-4f5c-bd04-14fc2e143cde tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.162381 May 10 20:30:04.906871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 225/425] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:04 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:04.994076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:04.994692 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:05.001274 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:05.001895 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:05.002577 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:05.003017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:05.139737 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:05.148069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:05.149679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:05.150861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2b773506-e353-49a2-9f76-1bbd99ba1189 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.160682 May 10 20:30:05.151636 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 226/426] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:04 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:05.913682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:05.914332 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:05.920442 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:05.920895 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:05.921711 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:05.922156 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:06.065751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:06.073772 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f01ebc73-ffc9-4b97-842f-60a5b1d646d7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.164094 May 10 20:30:06.082987 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 227/427] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:05 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:06.168863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:06.169518 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:06.176245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:06.176689 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:06.177504 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:06.177947 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:06.314214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:06.327651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:06.329255 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:06.330465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f583ee40-b5cc-4e9d-af6f-32929798d27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.165526 May 10 20:30:06.331066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 228/428] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:06 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:07.090718 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:07.091463 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:07.097878 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:07.098330 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:07.099129 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:07.099572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:07.242227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:07.249856 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-56b0fb3c-ebe3-4668-ad6f-f8ff14e35bcd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.163350 May 10 20:30:07.250429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 229/429] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:07 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:07.348360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:07.348886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:07.363448 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:07.363821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:07.364648 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:07.365357 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:07.509349 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:07.519911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:07.522366 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:07.523562 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-518a7d37-3d17-4a5d-8593-2c5e59287e03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.179462 May 10 20:30:07.524126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 230/430] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:07 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:08.267245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:08.267985 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:08.275377 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:08.275933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:08.276725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:08.277194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:08.414714 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:08.423678 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c026f70d-ee3b-49f4-8ad5-f8fb3bf7a106 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.160317 May 10 20:30:08.424563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 231/431] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:08 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:08.542390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:08.543074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:08.548948 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:08.549494 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:08.550420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:08.550859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:08.701349 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:08.712671 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:08.714386 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:08.715614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ab072f77-cae1-4572-a0c1-66e68c48b112 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.177546 May 10 20:30:08.716822 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 232/432] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:08 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:09.439758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:09.440397 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:09.447493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:09.448008 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:09.448808 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:09.450605 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:09.650775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:09.662929 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e1f57682-017d-4f4a-9099-c2bd42277585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.227011 May 10 20:30:09.663725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 233/433] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:09 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:09.674166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] validate_networks() for [('a39b073b-dc0a-4098-8dbd-0428d76eaadb', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:30:09.735272 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:09.736025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:09.743252 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:09.744437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:09.745647 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:09.746269 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:10.010364 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:10.021689 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:10.023611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:10.025373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fb3af3e2-b1be-485b-8b2f-b8503b916ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.294526 May 10 20:30:10.037020 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 234/434] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:09 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:10.331547 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:30:10.331975 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:30:10.332450 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:30:10.332867 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:30:10.333311 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:30:10.360307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:10.364388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:10.367188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:10.370140 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:10.419200 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:30:10.426715 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Getting quotas for user df3cf8a2f7c54b80aac61d6ca59672b5 and project 67dae2f388bc4a81bc957f48b1b02e42. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:30:10.446236 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:30:10.450003 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:30:10.557811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-30d0f946-deb7-4132-a025-02f148da9cc5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 13.733010 May 10 20:30:10.561307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 201/435] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:29:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 13738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:30:10.573944 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-728a4cdc-e12a-4c0d-80e9-a985fe1fb3f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:10.575351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-728a4cdc-e12a-4c0d-80e9-a985fe1fb3f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:10.680588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:10.682148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:10.687797 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-728a4cdc-e12a-4c0d-80e9-a985fe1fb3f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:10.700459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:10.700912 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:10.701737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:10.702179 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:10.709568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-728a4cdc-e12a-4c0d-80e9-a985fe1fb3f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1245 microversion: 2.1 time: 0.142770 May 10 20:30:10.721431 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 235/436] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:10 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1245 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:10.954736 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:10.964255 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e9a3407f-91e5-4a67-b311-a0e7de4ee9cd tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.287939 May 10 20:30:10.977877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 202/437] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:10 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:11.045586 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:11.046837 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:11.062950 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:11.065506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:11.067484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:11.069921 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:11.322660 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:11.335799 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:11.339835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:11.341974 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ed34e8ae-6e64-4f4e-8a84-bf1ae5ec977e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.300788 May 10 20:30:11.342790 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 236/438] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:11 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:11.727661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:11.728916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:11.743326 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:11.744079 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:11.745114 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:11.745744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:11.856314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:11.872643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cdf7b082-1ee3-4ea2-85ed-811c79822563 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1241 microversion: 2.1 time: 0.148670 May 10 20:30:11.885366 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 203/439] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:11 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:11.982931 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:11.984309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:12.001289 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:12.002312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:12.014114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:12.014979 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:12.266754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:12.276777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-816b0e81-e210-426a-a6fe-4fa74b4874cf tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.298784 May 10 20:30:12.277820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 237/440] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:11 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:12.364208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:12.365263 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:12.373222 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:12.374151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:12.375454 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:12.376216 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:12.613563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:12.622348 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:12.623822 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:12.625266 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-16ce3f6d-bdc9-4238-829e-b380dbbde14f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.266791 May 10 20:30:12.625871 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 204/441] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:12 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:12.901440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:12.903291 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:12.919118 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:12.919561 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:12.920473 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:12.920926 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:13.008832 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:13.016952 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-60ffddf5-fb06-46e6-9186-1e2bf9949105 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.119313 May 10 20:30:13.017794 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 238/442] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:12 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:13.296850 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:13.301527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:13.308017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:13.308471 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:13.309288 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:13.309721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:13.473682 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:13.480963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-67ed7428-903e-465c-a0a7-a9d6636de7bb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.189181 May 10 20:30:13.481544 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 205/443] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:13 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:13.642684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:13.643290 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:13.649525 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:13.649977 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:13.650746 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:13.651185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:13.789079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:13.797000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:13.798514 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:13.799679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b5888b09-f842-45ce-9771-dceec1b3d7e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.160949 May 10 20:30:13.800801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 239/444] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:13 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:14.033553 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:14.034459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:14.040745 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:14.041222 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:14.042414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:14.042852 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:14.114299 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:14.121893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f9eff914-ad8f-4fea-9d78-19ca20d46d91 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.092065 May 10 20:30:14.122469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 206/445] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:14 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:14.497766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:14.498387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:14.515794 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:14.516119 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:14.517471 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:14.517961 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:14.683623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:14.692006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e2e60e3a-d9db-4fa6-9e41-af6183d5259d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.197963 May 10 20:30:14.693820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 240/446] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:14 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:14.819486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:14.820134 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:14.827400 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:14.827963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:14.828964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:14.829549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:15.025200 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:15.040031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:15.041960 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:15.043081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c15d2ba9-81ad-411e-8163-fa5b5f4c39ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.227758 May 10 20:30:15.051055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 207/447] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:14 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:15.139332 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:15.144091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:15.155080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:15.155747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:15.157198 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:15.157854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:15.245636 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:15.257738 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-17f46f58-aa46-480a-97b0-5c0ae44538bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.122146 May 10 20:30:15.258319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 241/448] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:15 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:15.711152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:15.712085 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:15.718221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:15.718677 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:15.719453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:15.719891 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:15.861102 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:15.868950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4dac556d-1dd5-4bc0-b06e-0cb906a1d02d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.161723 May 10 20:30:15.869853 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 208/449] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:15 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:16.061927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:16.062553 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:16.069759 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:16.070241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:16.071006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:16.071451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:16.205064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:16.213750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:16.215263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:16.216710 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c6cebaeb-3a3b-47fd-a1a2-bf00a2ac581c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.158700 May 10 20:30:16.217319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 242/450] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:16 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:16.276111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:16.276764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:16.283160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:16.283605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:16.284413 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:16.284853 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:16.349843 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:16.357462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-db8e62df-7725-449d-89d2-0d2175d31c6e tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.085810 May 10 20:30:16.358035 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 209/451] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:16 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:16.886557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:16.887486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:16.895522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:16.896226 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:16.897406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:16.897911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:17.091011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:17.099409 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-602a6ae5-d675-456d-993c-7a6217d5be41 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.217106 May 10 20:30:17.100092 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 243/452] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:16 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:17.235203 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:17.236485 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:17.244616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:17.245134 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:17.245919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:17.246357 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:17.375415 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:17.376117 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:17.382139 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:17.382677 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:17.383522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:17.384072 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:17.476426 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:17.480247 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:17.489877 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-aa2cb2d3-db3b-41c9-87be-ddac255ab2fa tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.118114 May 10 20:30:17.490629 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:17.492168 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:17.493030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 244/453] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:17 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:17.493356 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-122e7f53-e7bd-455e-a062-d9016fded5ed tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.262253 May 10 20:30:17.505019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 210/454] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:17 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:18.118750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:18.119411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:18.125922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:18.126372 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:18.127153 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:18.127589 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:18.290590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:18.298211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9c7386ae-4570-4352-96b3-871cd1cb305d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.183693 May 10 20:30:18.306229 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 245/455] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:18 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:18.512607 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:18.513393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:18.514135 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:18.514364 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:18.524445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:18.525201 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:18.526167 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:18.526774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:18.529575 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:18.530294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:18.531436 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:18.532048 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:18.707101 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:18.714671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2ef1c429-d130-4c9a-859f-8965a08e6c21 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.208593 May 10 20:30:18.725118 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 211/456] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:18 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:18.827970 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:18.841152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:18.842951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:18.844467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-effa6013-e15a-4159-a499-c123b0bb069a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.336809 May 10 20:30:18.845200 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 246/457] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:18 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:19.322547 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:19.323448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:19.335474 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:19.335863 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:19.336663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:19.337142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:19.731591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:19.732359 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:19.744038 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:19.746316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:19.748847 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:19.757612 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:20.131532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:20.149949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-32349e34-3a84-42a4-b6bb-d1fdadec175b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.415367 May 10 20:30:20.153376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 247/458] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:19 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:20.166438 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9b7a2909-32e6-4484-923a-faf162704910 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3116c733-1484-4630-b535-c4d56bfbbaba", "device": "/dev/sdb"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:20.170852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9b7a2909-32e6-4484-923a-faf162704910 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:20.172622 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:20.187376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7a2909-32e6-4484-923a-faf162704910 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:20.188079 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f324232b-c8d4-4d49-b869-2e221ce20634 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.868446 May 10 20:30:20.189827 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 212/459] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:19 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:20.190287 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7a2909-32e6-4484-923a-faf162704910 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:20.191253 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7a2909-32e6-4484-923a-faf162704910 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:20.192322 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7a2909-32e6-4484-923a-faf162704910 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:20.208886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:20.211738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:20.225516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:20.226026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:20.232490 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:20.233249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:20.536418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:20.562286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:20.574978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:20.579087 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8eb550f5-2c8c-470e-b9ea-9f9fc8a28bad tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.379763 May 10 20:30:20.579756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 213/460] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:20 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:21.132101 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9b7a2909-32e6-4484-923a-faf162704910 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "POST /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977283 May 10 20:30:21.133395 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 248/461] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:30:20 2022] POST /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2/os-volume_attachments => generated 194 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:21.168466 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:21.169189 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:21.175724 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:21.176337 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:21.177052 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:21.177565 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:21.208682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:21.209692 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:21.223667 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:21.226408 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:21.227440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:21.230032 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:21.409225 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:21.422184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b2ad36f7-e34f-4303-b25b-3d6157279788 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.257235 May 10 20:30:21.423952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 214/462] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:21 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:21.601666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:21.604869 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:21.618405 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:21.620800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:21.621966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:21.629393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:21.638557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:21.648835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-66f3825e-5c80-4ad8-b1c4-43c411bc03c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.445621 May 10 20:30:21.672465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 249/463] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:21 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:21.934976 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:21.954752 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:21.960592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:21.969064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2da7f595-3afc-4f42-94f0-6c5fde1ffcc7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.365283 May 10 20:30:21.985225 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 215/464] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:21 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:22.439658 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:22.442314 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:22.457383 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:22.458246 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:22.459307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:22.459973 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:22.578590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:22.594702 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-73de354f-9dc8-4b70-bb47-38154e2ad8bc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1297 microversion: 2.1 time: 0.158688 May 10 20:30:22.599068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 250/465] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:22 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1297 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:22.680106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:22.680751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:22.696953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:22.697707 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:22.698860 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:22.699453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:22.918113 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:22.927432 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ecd81227-228d-45aa-a7a4-e5a6edf01abb tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.253202 May 10 20:30:22.928624 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 216/466] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:22 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:22.991849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:22.992461 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:23.001701 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:23.002133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:23.003481 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:23.003920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:23.345036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:23.356780 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:23.360208 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:23.363506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-49118f0e-eb7c-4d34-8e47-6591736f8f6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.374328 May 10 20:30:23.364294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 251/467] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:22 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:23.617726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:23.617851 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:23.628251 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:23.628707 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:23.629532 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:23.629968 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:23.779932 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:23.793150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-45ebd518-423d-4885-b55a-21a13598397d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1303 microversion: 2.1 time: 0.182240 May 10 20:30:23.795996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 217/468] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:23 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1303 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:23.945095 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:23.947049 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:23.958917 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:23.959597 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:23.961399 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:23.964655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:24.153245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:24.162574 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e21b7adb-c3ad-4e3c-b487-dcbb84df970a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.221445 May 10 20:30:24.177723 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 252/469] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:23 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:24.381653 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:24.382648 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:24.394293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:24.398080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:24.399162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:24.399808 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:24.685192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:24.693362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:24.700496 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:24.704057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-264d6870-e8e7-436d-818b-26a1ecc376fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.326472 May 10 20:30:24.712325 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 218/470] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:24 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:24.813751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:24.823560 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:24.836084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:24.837205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:24.838279 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:24.838879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:25.002346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:25.031789 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f042d78d-56ab-422d-9c7d-9891fd671f25 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1303 microversion: 2.1 time: 0.215305 May 10 20:30:25.036468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 253/471] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:24 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1303 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:25.188446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:25.192621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:25.208325 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:25.215409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:25.216554 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:25.217339 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:25.434781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:25.447213 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8fea7e30-4c86-461e-a394-93a7d270f8fa tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.264167 May 10 20:30:25.448045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 219/472] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:25 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:25.734009 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:25.734637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:25.752099 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:25.752562 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:25.753440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:25.753918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:25.991369 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:26.005467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:26.008219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:26.011134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9de1a9d9-1cda-4017-940b-5ca9702a99d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.279688 May 10 20:30:26.012270 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 254/473] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:25 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:26.060918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:26.063673 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:26.087003 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:26.090400 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:26.092083 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:26.092702 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:26.301817 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:26.313777 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-78fd9703-d47a-44c0-9f9f-2f7b9dc1c007 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.264007 May 10 20:30:26.314996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 220/474] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:26 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:26.343639 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-c0d46825-b21d-4617-9cac-f4386de59ded req-f1720d9d-f6e8-46c6-b9c9-2e2deed09516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6131f4a-2a40-4b33-bf35-763bb6dbf01c", "name": "network-vif-plugged", "status": "completed", "tag": "17b60462-c5b3-4701-9d7d-de886673ef7d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:26.358007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-c0d46825-b21d-4617-9cac-f4386de59ded req-f1720d9d-f6e8-46c6-b9c9-2e2deed09516 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:26.358454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-c0d46825-b21d-4617-9cac-f4386de59ded req-f1720d9d-f6e8-46c6-b9c9-2e2deed09516 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:26.380264 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-c0d46825-b21d-4617-9cac-f4386de59ded req-f1720d9d-f6e8-46c6-b9c9-2e2deed09516 service nova] Creating event network-vif-plugged:17b60462-c5b3-4701-9d7d-de886673ef7d for instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c on hv-cinder-82880 May 10 20:30:26.398968 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-c0d46825-b21d-4617-9cac-f4386de59ded req-f1720d9d-f6e8-46c6-b9c9-2e2deed09516 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058757 May 10 20:30:26.399847 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 255/475] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:26.464772 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:26.465815 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:26.475141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:26.475994 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:26.483083 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:26.483797 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:26.871297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:26.887452 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d8877ff7-d27f-4c96-90c9-19b616a96840 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.424344 May 10 20:30:26.891061 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 221/476] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:26 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:27.032068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:27.033463 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:27.040549 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:27.041321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:27.042355 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:27.043032 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:27.259305 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:27.270906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:27.273659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:27.274835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1708ae42-57d1-447e-b044-ccad03835724 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.247478 May 10 20:30:27.275816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 256/477] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:27 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:27.348892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:27.350190 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:27.359033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:27.359846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:27.360737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:27.361473 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:27.584515 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:27.592613 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ee1ad358-5e8e-4141-a945-7b2987d5db7a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.263361 May 10 20:30:27.594639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 222/478] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:27 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:27.907880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:27.908496 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:27.921655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:27.921655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:27.928189 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:27.931262 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:28.228844 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:28.236860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d3fb3250-5632-46ac-8399-71aa85396173 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1356 microversion: 2.1 time: 0.332732 May 10 20:30:28.238954 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 257/479] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:27 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1356 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:28.271518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-defcd93c-5305-4d3d-98f5-3c266bae7a09 req-70076643-f7c6-433f-aa30-e2389ca4b52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47fb1639-3b60-43d2-8dfe-60110e829a8d", "tag": "47de41f7-9f27-4859-b152-66f1ab4268f4"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:28.289262 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-defcd93c-5305-4d3d-98f5-3c266bae7a09 req-70076643-f7c6-433f-aa30-e2389ca4b52b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:28.293258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:28.293746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-defcd93c-5305-4d3d-98f5-3c266bae7a09 req-70076643-f7c6-433f-aa30-e2389ca4b52b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:28.293879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:28.306363 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:28.306822 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:28.308167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:28.308613 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:28.314982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-defcd93c-5305-4d3d-98f5-3c266bae7a09 req-70076643-f7c6-433f-aa30-e2389ca4b52b service nova] Creating event network-changed:47de41f7-9f27-4859-b152-66f1ab4268f4 for instance 47fb1639-3b60-43d2-8dfe-60110e829a8d on hv-cinder-82880 May 10 20:30:28.327789 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-defcd93c-5305-4d3d-98f5-3c266bae7a09 req-70076643-f7c6-433f-aa30-e2389ca4b52b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063399 May 10 20:30:28.332997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 223/480] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:28.577256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:28.585797 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:28.588635 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:28.590150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-82538bb2-5068-4a51-99e2-acffe9221350 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.300628 May 10 20:30:28.602669 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 258/481] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:28 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:28.611651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:28.612886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:28.619974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:28.620443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:28.621255 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:28.621701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:28.827912 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:28.849249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0ee9f8b9-fc85-4367-b202-bab4cab008f2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.242144 May 10 20:30:28.854033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 224/482] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:28 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:29.258152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:29.258818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:29.271526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:29.272273 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:29.277013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:29.278375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:29.607643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:29.608269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:29.625293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:29.626004 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:29.626523 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:29.627196 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:29.676630 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:29.687889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ce1e98f2-6984-4084-9e82-6f6774f80c70 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1546 microversion: 2.1 time: 0.435660 May 10 20:30:29.700800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 259/483] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:29 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1546 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:29.708063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:29.719999 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:29.734239 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:29.739949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:29.741730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:29.742181 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:30.027958 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:30.054540 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-24a0d169-bf35-42c3-aa33-5c801eff0c55 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1546 microversion: 2.1 time: 0.351439 May 10 20:30:30.055563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 260/484] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:29 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1546 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:30.098470 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:30.099083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:30.122077 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:30.126668 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:30.128298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:30.128917 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:30.137905 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:30.171316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:30.173446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:30.176031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bcb25011-af06-46d7-8a3f-b4497e8e0cce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.572320 May 10 20:30:30.190876 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 225/485] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:29 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:30.201053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:30.222057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:30.227107 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Searching by: {'deleted': False, 'project_id': '51884a66cf014d6596d22c37c4a97147'} {{(pid=117260) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 20:30:30.256254 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:30.256942 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:30.257800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:30.258230 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:30.469274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.multi_cell_list [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117260) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 20:30:30.612844 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f87a369a-bbbd-4335-ae66-2ce3f8e99546 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.419854 May 10 20:30:30.618842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 226/486] 10.222.0.61 () {58 vars in 1124 bytes} [Tue May 10 20:30:30 2022] GET /compute/v2.1/servers => generated 342 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:30.624355 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:30.625291 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:30.627284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:30.633272 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:30.636854 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:30.638233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:30.638830 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:30.654949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2f3a2c25-ad50-4334-9b34-6c24e18cc018 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.585560 May 10 20:30:30.656557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 261/487] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:30 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:30.864470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:30.877000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a6fd4c23-6823-4580-b2e7-eb572dc2a8ab tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1546 microversion: 2.1 time: 0.254858 May 10 20:30:30.906327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 227/488] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:30 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:31.199140 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:31.200195 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:31.214029 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:31.214893 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:31.215989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:31.224282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:31.682094 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:31.683358 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:31.696025 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:31.696480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:31.701389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:31.702026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:32.216046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:32.241275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:32.242656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:32.248520 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-325d59a5-38f3-45a3-8c7d-317377a9620c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 1.055928 May 10 20:30:32.249656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 262/489] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:31 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:32.327176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:32.343582 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d859a32b-4b7a-427d-bd18-41ef9bd0f3d1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.672861 May 10 20:30:32.353378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 228/490] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:31 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:33.097015 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ac720531-8597-402f-b89a-5873f91ae620 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3af27f3d-fe6d-4785-b52a-79d5320f0770"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:33.098479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ac720531-8597-402f-b89a-5873f91ae620 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:33.108338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac720531-8597-402f-b89a-5873f91ae620 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:33.109228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac720531-8597-402f-b89a-5873f91ae620 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:33.110331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac720531-8597-402f-b89a-5873f91ae620 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:33.110919 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac720531-8597-402f-b89a-5873f91ae620 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:33.273977 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:33.274596 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:33.306739 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:33.307447 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:33.310573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:33.311294 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:33.907808 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:33.916276 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:33.929245 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:33.931864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2379ebf2-874c-4191-a5b9-9f617e02185a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.668079 May 10 20:30:33.938442 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 229/491] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:33 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:33.945244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:33.951569 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:33.966530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:33.974224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:33.975670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:33.976628 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:34.257343 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:34.278112 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-af6ecdfb-0f64-460e-8459-08331c8296bb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.337841 May 10 20:30:34.279657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 230/492] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:33 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:34.951021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:34.951636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:34.959622 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:34.964195 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:34.965313 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:34.966146 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:35.254768 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:35.273692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:35.281841 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:35.284885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-01b97aca-8dc3-48c4-9475-031c17876218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.337705 May 10 20:30:35.293595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 231/493] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:34 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:35.301527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:35.304066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:35.312950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:35.315900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:35.317055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:35.317727 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:35.512946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ac720531-8597-402f-b89a-5873f91ae620 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.441627 May 10 20:30:35.523039 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 263/494] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:30:33 2022] POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments => generated 194 bytes in 2453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:35.643171 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:35.651668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-05d69b9b-9841-4d50-bcf5-27d2521d1996 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.356574 May 10 20:30:35.653859 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 232/495] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:35 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:36.305657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:36.306358 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:36.320026 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:36.322478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:36.325214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:36.325860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:36.672609 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:36.682526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:36.736006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:36.744088 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:36.747599 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:36.750678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:36.926803 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:36.974588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:36.977876 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:36.996061 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-424024aa-4525-4c84-a7d0-98d6616d7e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.695188 May 10 20:30:37.000073 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 264/496] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:36 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:37.175781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:37.199147 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6d6241b1-e215-44d6-82a2-13fbd50ae62c tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.525818 May 10 20:30:37.209355 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 233/497] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:36 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:38.019319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:38.022418 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:38.059502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:38.061338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:38.065217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:38.068179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:38.219881 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:38.220467 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:38.239492 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:38.241366 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:38.246443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:38.249739 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:38.375415 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:38.403057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:38.407085 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:38.411971 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ecb70777-96ff-436f-8fc5-5611d15cf053 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.399915 May 10 20:30:38.412551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 265/498] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:38 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:38.603021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:38.611137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-edcb6486-df6f-456d-983f-f7ebd82c1329 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.395256 May 10 20:30:38.612359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 234/499] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:38 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:39.070746 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0b8c250c-daaf-472a-9a22-972e5a7c8186 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Action: 'create', calling method: .version_select at 0x7fb2734539d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-786161446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQPV28v8yl9//Z0eT1sY4KDpI2NAe2WHz84JpR12/RaDT97JU7uPCgwfaNSUuDBn3bxnfIrtbJuHSVz03IZoIhgkdcPRiX79b8Uvct2fwdAntX7dlyiLnhdMzwyf8AuIw=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:39.089528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-0b8c250c-daaf-472a-9a22-972e5a7c8186 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:30:39.098928 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-0b8c250c-daaf-472a-9a22-972e5a7c8186 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for user 17f6eadae19c4b7b8bd66e21ae302363 and project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:30:39.135861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0b8c250c-daaf-472a-9a22-972e5a7c8186 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.435519 May 10 20:30:39.138178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 266/500] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:30:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:39.432542 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:39.433303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:39.451555 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:39.452008 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:39.464638 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:39.465512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:39.649273 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:39.649935 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:39.711053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:39.712405 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:39.713594 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:39.727021 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:39.791931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:39.808483 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:39.812447 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:39.818761 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d486bfda-afbd-4186-85f4-b1d0e1092ffb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1741 microversion: 2.20 time: 0.392289 May 10 20:30:39.821618 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 235/501] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:39 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1741 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:39.948276 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:39.960234 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f8ab5c07-0913-4c7c-a5d4-16052e027b52 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.336376 May 10 20:30:39.961478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 267/502] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:39 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:40.840321 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:40.841986 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:40.853303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:40.853995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:40.854774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:40.855360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:40.980467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:40.985467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:41.004249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:41.010372 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:41.011393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:41.011956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:41.212631 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:41.225523 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:41.229757 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:41.233399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b5851390-5579-424d-8b2d-cc5bbeafc568 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1723 microversion: 2.20 time: 0.398011 May 10 20:30:41.235389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 236/503] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:40 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:41.415172 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:41.432345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-aac3b36f-e923-435f-85cf-3b282b27e949 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.458417 May 10 20:30:41.433126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 268/504] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:40 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:41.786747 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-829bd9e4-4a8b-48bc-b462-d740329bfd18 req-2f0cea4e-ff5e-44ad-b481-4001bee3d012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47fb1639-3b60-43d2-8dfe-60110e829a8d", "name": "network-vif-plugged", "status": "completed", "tag": "47de41f7-9f27-4859-b152-66f1ab4268f4"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:41.796888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-829bd9e4-4a8b-48bc-b462-d740329bfd18 req-2f0cea4e-ff5e-44ad-b481-4001bee3d012 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:41.797512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-829bd9e4-4a8b-48bc-b462-d740329bfd18 req-2f0cea4e-ff5e-44ad-b481-4001bee3d012 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:41.811332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-829bd9e4-4a8b-48bc-b462-d740329bfd18 req-2f0cea4e-ff5e-44ad-b481-4001bee3d012 service nova] Creating event network-vif-plugged:47de41f7-9f27-4859-b152-66f1ab4268f4 for instance 47fb1639-3b60-43d2-8dfe-60110e829a8d on hv-cinder-82880 May 10 20:30:41.818565 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-829bd9e4-4a8b-48bc-b462-d740329bfd18 req-2f0cea4e-ff5e-44ad-b481-4001bee3d012 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035539 May 10 20:30:41.819607 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 237/505] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:42.259521 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:42.260942 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:42.268147 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:42.268815 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:42.270648 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:42.271541 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:42.450827 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:42.451456 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:42.466606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:42.467601 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:42.469380 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:42.470040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:42.480373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:42.494232 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:42.495878 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:42.497495 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fc6df8f3-3571-4cf3-8a4d-c3e2219a4c6a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1723 microversion: 2.20 time: 0.249259 May 10 20:30:42.498282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 269/506] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:42 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:42.642382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:42.650806 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d48bb8a3-b0d0-4a9c-9bd2-a8da32c4b5ff tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.204214 May 10 20:30:42.651574 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 238/507] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:42 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:43.519504 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:43.527492 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:43.535007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:43.535507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:43.536258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:43.536696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:43.668964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:43.669692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:43.683729 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:43.684503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:43.685350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:43.685803 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:43.714452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:43.728206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:43.731876 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:43.733580 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-41dca1f7-29f4-47eb-89a3-1abbcb8685e9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1723 microversion: 2.20 time: 0.219082 May 10 20:30:43.739882 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 270/508] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:43 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:43.842811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:43.852166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a9760b1f-5d8a-45f5-95c9-34e7a6479128 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.188154 May 10 20:30:43.852884 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 239/509] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:43 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:44.751690 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:44.752300 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:44.758885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:44.759340 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:44.760125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:44.760566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:44.868480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:44.870097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:44.886287 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:44.886749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:44.890177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:44.890890 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:44.950074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:44.960562 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:44.973655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:44.975280 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-211b390c-965f-4b5e-bdf6-0b96b57cfa08 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1723 microversion: 2.20 time: 0.227541 May 10 20:30:44.976697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 271/510] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:44 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:45.085360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:45.094316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a9d187b5-3360-458d-9ae3-68d0b60e9cd5 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.229594 May 10 20:30:45.095332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 240/511] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:44 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:45.711893 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-27a2416b-0c38-4fa3-a9c1-902e1812016b req-03903603-62b1-47d9-bc8b-e25025e33102 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa24eb7-cd9f-4ca7-bad7-5c275879fecd", "name": "network-vif-unplugged", "status": "completed", "tag": "d8fb0937-0365-4e3b-b493-e0343c1b6efa"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:45.727334 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-27a2416b-0c38-4fa3-a9c1-902e1812016b req-03903603-62b1-47d9-bc8b-e25025e33102 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:45.727786 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-27a2416b-0c38-4fa3-a9c1-902e1812016b req-03903603-62b1-47d9-bc8b-e25025e33102 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:45.742145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-27a2416b-0c38-4fa3-a9c1-902e1812016b req-03903603-62b1-47d9-bc8b-e25025e33102 service nova] Creating event network-vif-unplugged:d8fb0937-0365-4e3b-b493-e0343c1b6efa for instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd on hv-cinder-82880 May 10 20:30:45.747549 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-27a2416b-0c38-4fa3-a9c1-902e1812016b req-03903603-62b1-47d9-bc8b-e25025e33102 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039590 May 10 20:30:45.749165 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 272/512] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:45.994390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:45.995007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:46.001517 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:46.002013 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:46.002794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:46.003406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:46.113003 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:46.114344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:46.120647 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:46.121243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:46.122298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:46.122804 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:46.138955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:46.147234 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:46.149102 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:46.150456 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ca23412b-fe17-4cd1-a76f-ce5323dca461 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1723 microversion: 2.20 time: 0.159890 May 10 20:30:46.161508 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 241/513] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:45 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:46.256585 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:46.265380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-eeb21f8e-b12f-443a-9f0a-d5796275537f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.157522 May 10 20:30:46.275203 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 273/514] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:46 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:47.170366 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:47.171011 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:47.178439 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:47.178896 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:47.179674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:47.180117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:47.282631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:47.284013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:47.293023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:47.293023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:47.293023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:47.293023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:47.313717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:47.321593 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:47.323102 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:47.324264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-67377aa2-18c0-4aab-bb7a-4acf5b77866c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1723 microversion: 2.20 time: 0.157811 May 10 20:30:47.324824 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 242/515] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:47 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:47.419158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:47.426431 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d3aecf1c-bd16-49a7-a353-a59be888af5d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.147631 May 10 20:30:47.426994 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 274/516] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:47 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:47.791107 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:47.791725 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:47.797737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:47.798196 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:47.799560 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:47.799991 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:47.964448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:47.973497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0fb15c1c-7efc-4636-82f6-d9a04f7387ba tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1592 microversion: 2.1 time: 0.186087 May 10 20:30:47.974985 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 243/517] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:47 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1592 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:48.343351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:48.343867 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:48.351463 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.352181 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.353752 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.354464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.443965 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:48.444500 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:48.450698 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.451149 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.451917 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.452345 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.622307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:48.632135 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:48.633942 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:48.635176 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4e61ae16-28c5-468c-b04a-9419126305be tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1726 microversion: 2.20 time: 0.295851 May 10 20:30:48.635749 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 275/518] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:48 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1726 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:48.653588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-707fcf22-c23b-4329-804f-c29682aeb82b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3c50a5d-349c-477e-9801-48bb3d7bf66c"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:48.654652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-707fcf22-c23b-4329-804f-c29682aeb82b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:48.660729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-707fcf22-c23b-4329-804f-c29682aeb82b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.661223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-707fcf22-c23b-4329-804f-c29682aeb82b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.662005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-707fcf22-c23b-4329-804f-c29682aeb82b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.662454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-707fcf22-c23b-4329-804f-c29682aeb82b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.668916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:48.676817 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9eae6ad2-db25-471e-ad32-2777a38c3e8f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1371 microversion: 2.1 time: 0.237234 May 10 20:30:48.677652 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 244/519] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:48 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:30:48.810164 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:48.810764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:48.819616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.820580 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.821791 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:48.822294 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:48.982293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'services' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:30:48.998635 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-707fcf22-c23b-4329-804f-c29682aeb82b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.349101 May 10 20:30:48.999254 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 276/520] 10.222.0.61 () {62 vars in 1363 bytes} [Tue May 10 20:30:48 2022] POST /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments => generated 188 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 20:30:49.125606 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-76fdb83b-aa39-4d5e-bf20-1f786eb317d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:49.127249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-76fdb83b-aa39-4d5e-bf20-1f786eb317d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:49.134027 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a4762566-5f36-43cf-a276-05c1dbcc63cc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2/os-volume_attachments/3116c733-1484-4630-b535-c4d56bfbbaba" status: 202 len: 0 microversion: 2.1 time: 0.327237 May 10 20:30:49.134700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-76fdb83b-aa39-4d5e-bf20-1f786eb317d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:49.135158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-76fdb83b-aa39-4d5e-bf20-1f786eb317d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:49.135567 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 245/521] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:30:48 2022] DELETE /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2/os-volume_attachments/3116c733-1484-4630-b535-c4d56bfbbaba => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:30:49.136087 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-76fdb83b-aa39-4d5e-bf20-1f786eb317d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:49.136657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-76fdb83b-aa39-4d5e-bf20-1f786eb317d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:49.264552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-76fdb83b-aa39-4d5e-bf20-1f786eb317d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/action" status: 202 len: 0 microversion: 2.20 time: 0.143217 May 10 20:30:49.265191 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 277/522] 10.222.0.61 () {62 vars in 1318 bytes} [Tue May 10 20:30:49 2022] POST /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 20:30:49.277362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:49.278794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:49.286940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:49.287390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:49.288359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:49.288997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:49.521410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:49.532125 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:49.533922 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:49.535228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c26ce142-4a8e-4cd3-ab0c-52f9cc8cbd1f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1752 microversion: 2.20 time: 0.265023 May 10 20:30:49.536000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 246/523] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:49 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1752 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:49.694163 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:49.695199 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:49.702287 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:49.703005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:49.703896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:49.704683 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:50.141572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:50.150018 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-34aa9a53-1358-4b2c-95de-0d0052213a01 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1565 microversion: 2.1 time: 0.460573 May 10 20:30:50.150588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 278/524] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:49 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1565 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:50.167146 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d258ebbd-93de-4ab0-b49f-55c620014741 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:50.167686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d258ebbd-93de-4ab0-b49f-55c620014741 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:50.173595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d258ebbd-93de-4ab0-b49f-55c620014741 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:50.174051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d258ebbd-93de-4ab0-b49f-55c620014741 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:50.174834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d258ebbd-93de-4ab0-b49f-55c620014741 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:50.175279 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d258ebbd-93de-4ab0-b49f-55c620014741 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:50.294010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d258ebbd-93de-4ab0-b49f-55c620014741 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.130445 May 10 20:30:50.294707 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 247/525] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:30:50 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-interface => generated 284 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:50.555340 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:50.556022 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:50.562575 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:50.563030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:50.570973 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:50.571802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:50.640654 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-728842fd-dd3d-47fa-a7a3-3dbeb2ae8096 req-fc3e7bd3-7430-4adc-aa50-923bad57710b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6131f4a-2a40-4b33-bf35-763bb6dbf01c", "tag": "17b60462-c5b3-4701-9d7d-de886673ef7d"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:50.667324 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-728842fd-dd3d-47fa-a7a3-3dbeb2ae8096 req-fc3e7bd3-7430-4adc-aa50-923bad57710b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:50.667759 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-728842fd-dd3d-47fa-a7a3-3dbeb2ae8096 req-fc3e7bd3-7430-4adc-aa50-923bad57710b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:50.696527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-728842fd-dd3d-47fa-a7a3-3dbeb2ae8096 req-fc3e7bd3-7430-4adc-aa50-923bad57710b service nova] Creating event network-changed:17b60462-c5b3-4701-9d7d-de886673ef7d for instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c on hv-cinder-82880 May 10 20:30:50.712628 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-728842fd-dd3d-47fa-a7a3-3dbeb2ae8096 req-fc3e7bd3-7430-4adc-aa50-923bad57710b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070210 May 10 20:30:50.713597 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 248/526] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:30:50.853111 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:50.863039 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:50.869911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:50.872773 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-cdc6821d-029f-4c8c-b45e-aa6247570130 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1754 microversion: 2.20 time: 0.321928 May 10 20:30:50.873420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 279/527] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:50 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1754 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:51.346368 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:51.346835 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:51.363148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:51.363891 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:51.365738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:51.366669 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:51.404066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:30:51.555734 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f7d809ee-d8b8-4832-b649-d719140549f2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 204 len: 0 microversion: 2.1 time: 0.214121 May 10 20:30:51.557663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 249/528] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:30:51 2022] DELETE /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:30:51.566744 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:51.567626 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:51.584678 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:51.585396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:51.586424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:51.587252 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:51.776736 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:51.795698 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bc4cda0d-9e9d-41ad-aea3-2aaa74b98320 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1515 microversion: 2.1 time: 0.233489 May 10 20:30:51.796287 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 280/529] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:51 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1515 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:51.892811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:51.894372 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:51.901821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:51.902382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:51.903469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:51.904057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.053733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:52.062500 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:52.064274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:52.065477 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-213c6ab2-9f8d-4d9f-bfa7-94c250a0d957 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1754 microversion: 2.20 time: 0.177550 May 10 20:30:52.066039 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 250/530] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:51 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:52.246101 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1083560296"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:52.246640 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:52.253077 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.253523 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.254298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.254750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.347829 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-eb241725-1d6b-480a-a4a1-debb6ea01eda req-7619b9d8-4ff8-43bf-8ecf-d6074e1d0be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47fb1639-3b60-43d2-8dfe-60110e829a8d", "tag": "47de41f7-9f27-4859-b152-66f1ab4268f4"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:52.358904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-eb241725-1d6b-480a-a4a1-debb6ea01eda req-7619b9d8-4ff8-43bf-8ecf-d6074e1d0be0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.359354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-eb241725-1d6b-480a-a4a1-debb6ea01eda req-7619b9d8-4ff8-43bf-8ecf-d6074e1d0be0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.371112 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-eb241725-1d6b-480a-a4a1-debb6ea01eda req-7619b9d8-4ff8-43bf-8ecf-d6074e1d0be0 service nova] Creating event network-changed:47de41f7-9f27-4859-b152-66f1ab4268f4 for instance 47fb1639-3b60-43d2-8dfe-60110e829a8d on hv-cinder-82880 May 10 20:30:52.377639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-eb241725-1d6b-480a-a4a1-debb6ea01eda req-7619b9d8-4ff8-43bf-8ecf-d6074e1d0be0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032634 May 10 20:30:52.378536 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 251/531] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:30:52.395526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.network.security_group_api [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Adding security group 86e866fd-4b07-4350-b5c6-a58b9b5f56a8 to port 17b60462-c5b3-4701-9d7d-de886673ef7d May 10 20:30:52.753213 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8c635940-8843-4e82-a487-8c500092ce26 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/action" status: 202 len: 0 microversion: 2.1 time: 0.510898 May 10 20:30:52.753884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 281/532] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:30:52 2022] POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:30:52.767108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:52.768277 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:52.779948 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.780766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.782387 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.783876 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.788950 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-ee049909-e7f4-461d-9dda-a8b9245cdaf5 req-6cec050a-2b47-499f-8451-edb7bb34aa31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6131f4a-2a40-4b33-bf35-763bb6dbf01c", "tag": "17b60462-c5b3-4701-9d7d-de886673ef7d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:52.801415 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-ee049909-e7f4-461d-9dda-a8b9245cdaf5 req-6cec050a-2b47-499f-8451-edb7bb34aa31 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.801863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-ee049909-e7f4-461d-9dda-a8b9245cdaf5 req-6cec050a-2b47-499f-8451-edb7bb34aa31 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.820278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-ee049909-e7f4-461d-9dda-a8b9245cdaf5 req-6cec050a-2b47-499f-8451-edb7bb34aa31 service nova] Creating event network-changed:17b60462-c5b3-4701-9d7d-de886673ef7d for instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c on hv-cinder-82880 May 10 20:30:52.844117 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-ee049909-e7f4-461d-9dda-a8b9245cdaf5 req-6cec050a-2b47-499f-8451-edb7bb34aa31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058591 May 10 20:30:52.845110 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 282/533] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:30:52.851656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:52.852548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:52.859791 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.860922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:52.866685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:52.867478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:53.143850 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:53.148933 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:53.170018 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c89ff045-c57c-4707-b4af-9f12d7acc3f9 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1515 microversion: 2.1 time: 0.322940 May 10 20:30:53.171698 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-151055ab-dada-4e09-b615-839140670329 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1639 microversion: 2.1 time: 0.412367 May 10 20:30:53.172306 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 252/534] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:52 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1639 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:53.173249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 283/535] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:52 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1515 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:53.178268 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:53.179084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:53.187641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:53.188227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:53.188882 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:53.189481 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:53.333257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:53.342751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:53.345560 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:53.346769 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-665dc00c-542f-433a-8fa6-e2b20374a175 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1754 microversion: 2.20 time: 0.172331 May 10 20:30:53.347634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 284/536] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:53 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:54.190558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:54.191168 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:54.197640 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:54.198088 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:54.198879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:54.199314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:54.369437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:54.370578 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:54.378574 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:54.379308 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:54.380180 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:54.380671 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:54.428746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:54.439991 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-01178f24-138a-4755-a226-1695a9195d3a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1515 microversion: 2.1 time: 0.253751 May 10 20:30:54.454225 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 253/537] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:54 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1515 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:54.698188 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:54.709086 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:54.710749 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:54.712046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7350660d-d4a7-4736-9bb5-41b582269443 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.349877 May 10 20:30:54.719346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 285/538] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:54 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:30:55.458699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:55.459420 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:55.466166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:55.466764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:55.467604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:55.468143 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:55.485396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-0ba4f114-40a4-40d4-919c-aab5562f0748 req-185e5ee3-5ab1-41c4-8e1a-9d63be5df0ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d938abee-70d7-4d66-98a6-5479de0392b2", "name": "network-vif-deleted", "tag": "a1ca1f69-9459-48f3-a2ba-77bc7ce00384"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:30:55.499813 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0ba4f114-40a4-40d4-919c-aab5562f0748 req-185e5ee3-5ab1-41c4-8e1a-9d63be5df0ec service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:55.500278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0ba4f114-40a4-40d4-919c-aab5562f0748 req-185e5ee3-5ab1-41c4-8e1a-9d63be5df0ec service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:55.513699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-0ba4f114-40a4-40d4-919c-aab5562f0748 req-185e5ee3-5ab1-41c4-8e1a-9d63be5df0ec service nova] Creating event network-vif-deleted:a1ca1f69-9459-48f3-a2ba-77bc7ce00384 for instance d938abee-70d7-4d66-98a6-5479de0392b2 on hv-cinder-82880 May 10 20:30:55.524687 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-0ba4f114-40a4-40d4-919c-aab5562f0748 req-185e5ee3-5ab1-41c4-8e1a-9d63be5df0ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042495 May 10 20:30:55.525393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 286/539] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:30:55.544059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:55.557313 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7bd55a61-67a4-4d24-920e-fdf63b344e29 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1473 microversion: 2.1 time: 0.100892 May 10 20:30:55.558480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 254/540] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:55 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1473 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:55.731673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:55.732668 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:55.740480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:55.740930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:55.745843 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:55.746297 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:55.950553 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:55.960318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:55.962113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:55.963462 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e439d915-f65f-4290-9dbd-8dd94208d105 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.236311 May 10 20:30:55.975235 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 287/541] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:55 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:56.574968 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:56.576237 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:56.582849 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:56.583177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:56.583962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:56.584401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:56.620169 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:56.620721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:56.621215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:30:56.665429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:56.678072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9ffd8389-a268-4704-b577-7312f578f201 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.106958 May 10 20:30:56.679809 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 255/542] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:56 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:56.982248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:56.983621 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:56.991398 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:56.992185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:56.993262 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:56.993922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:57.137209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:57.155352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:57.156867 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:57.158644 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9584d669-e91c-4d65-870e-ca63fdd4dfba tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.179775 May 10 20:30:57.159195 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 288/543] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:56 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:57.698130 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:57.698845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:57.715057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:57.715505 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:57.716299 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:57.716729 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:57.753755 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:57.754541 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:57.755162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:30:57.795962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:57.804164 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-451adb39-3bbe-4d20-8e3b-a77b810e2e98 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.111886 May 10 20:30:57.804735 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 256/544] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:57 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:58.177158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:58.178612 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:58.187429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:58.188246 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:58.189783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:58.190454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:58.334470 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:58.344103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:58.345866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:58.347033 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-157b06a4-33af-4119-9f7a-f4476ec24238 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.174875 May 10 20:30:58.348047 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 289/545] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:58 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:58.821375 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:58.821983 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:58.829464 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:58.830221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:58.831018 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:58.831665 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:58.867083 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:58.867532 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:58.868125 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:30:58.915786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:58.924176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3edf55a0-7748-4ac6-8c19-e0f54108efc1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.106498 May 10 20:30:58.924717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 257/546] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:58 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:30:59.365537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:59.366084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:59.372302 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:59.372751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:59.373608 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:59.374042 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:59.531214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:59.539503 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:59.541058 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:30:59.542211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-516e18f6-913b-4e74-a57a-88a7bde4b5d4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.180862 May 10 20:30:59.542780 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 290/547] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:30:59 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:30:59.941059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:30:59.941709 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:30:59.947812 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:59.948262 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:59.949122 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:59.949556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:59.981574 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:30:59.982020 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:30:59.982653 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:00.022688 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:00.030529 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-557e6ff6-85ba-4a6e-b151-a15819d8b847 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.093437 May 10 20:31:00.031094 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 258/548] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:30:59 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:00.433875 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-187746389", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-786161446", "security_groups": [{"name": "tempest-secgroup-smoke-1677145085"}], "block_device_mapping_v2": [{"uuid": "1014ec4e-aeb1-4c38-87aa-2d8e23f432d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9d88ce3-6580-4789-923a-dc95426320f4"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:00.560210 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:00.561130 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:00.562313 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] validate_networks() for [('f9d88ce3-6580-4789-923a-dc95426320f4', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:31:00.568777 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:00.569432 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:00.570410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:00.571123 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:00.811196 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:00.820188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:00.822169 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:00.823361 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-eaab1702-22e1-4cf0-bc97-029cbe01ead6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.267538 May 10 20:31:00.823928 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 259/549] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:00 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:01.031508 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:31:01.031927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:31:01.032451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:31:01.032868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:31:01.033403 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:31:01.041919 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.042370 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.043197 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.043634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.047748 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:01.048363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:01.054676 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.055129 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.055903 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.056351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.060306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:31:01.065229 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for user 17f6eadae19c4b7b8bd66e21ae302363 and project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:31:01.093152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.093603 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.094059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:01.133484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:31:01.135959 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1014ec4e-aeb1-4c38-87aa-2d8e23f432d4',volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:31:01.162505 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:01.170868 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a0803796-1312-4d04-b68a-14ff3c1eaba0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.127045 May 10 20:31:01.171487 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 260/550] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:01 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:01.289245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ff0e7279-04d4-4a75-aaf2-68d261f187d5 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.859108 May 10 20:31:01.289900 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 291/551] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:31:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:31:01.301319 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-347e65a5-cdf3-41ad-ad79-ea52fa1d0389 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:01.302019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-347e65a5-cdf3-41ad-ad79-ea52fa1d0389 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:01.374174 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-347e65a5-cdf3-41ad-ad79-ea52fa1d0389 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:01.382571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-347e65a5-cdf3-41ad-ad79-ea52fa1d0389 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1093 microversion: 2.1 time: 0.086339 May 10 20:31:01.393378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 261/552] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:01 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:01.844557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:01.845743 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:01.851925 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.852388 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.853347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:01.853802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:01.998756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:02.008179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:02.010059 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:02.011174 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-532f7133-942c-487b-ad23-5f70c72184e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.172498 May 10 20:31:02.011735 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 292/553] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:01 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:02.187817 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:02.188474 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:02.194889 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:02.195351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:02.196131 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:02.196573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:02.228006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:02.228746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:02.229229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:02.270733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:02.279080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-00086adc-253e-4b28-990c-fab469ab1e0f tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.095088 May 10 20:31:02.279661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 262/554] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:02 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:02.401341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:02.401955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:02.408533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:02.408999 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:02.409784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:02.410222 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:02.485098 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:02.492507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-924c4e63-1783-4045-ae05-cb44c0644d5a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1143 microversion: 2.1 time: 0.095088 May 10 20:31:02.493139 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 293/555] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:02 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:03.032096 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:03.033396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:03.042923 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:03.043495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:03.044362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:03.044875 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:03.176786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:03.185268 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:03.186779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:03.187934 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5c15ad4c-8324-4ed4-a391-901d0f6364d7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.161386 May 10 20:31:03.188523 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 263/556] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:03 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:03.296209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:03.296901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:03.311965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:03.312713 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:03.314314 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:03.314951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:03.348794 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:03.349308 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:03.349765 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:03.401273 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:03.409800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-55ba54ac-16bf-46f8-85fe-92fea5c844b2 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.117556 May 10 20:31:03.420933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 294/557] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:03 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:03.509860 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:03.510468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:03.517649 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:03.518093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:03.518858 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:03.519292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:03.583419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:03.591361 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-77a8ddb5-e3d0-424f-a76d-465011901858 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1143 microversion: 2.1 time: 0.085211 May 10 20:31:03.592130 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 264/558] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:03 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:04.209036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:04.209759 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:04.216402 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:04.216859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:04.217681 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:04.218123 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:04.349718 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:04.358057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:04.359552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:04.361351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-608e8f39-9e96-46ba-9231-c1f7e5d0e9fc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.157359 May 10 20:31:04.361914 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 295/559] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:04 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:04.427452 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:04.428065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:04.433991 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:04.434426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:04.435205 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:04.435644 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:04.464851 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:04.465333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:04.465779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:04.507310 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:04.515053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d444f1bd-c34a-4c28-bd03-822119b76e3e tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.091419 May 10 20:31:04.515622 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 265/560] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:04 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:04.608090 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:04.608618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:04.615419 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:04.615884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:04.616654 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:04.617123 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:04.917483 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:04.925424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c343c619-3ca1-496b-a699-d1e51074d90c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1143 microversion: 2.1 time: 0.321246 May 10 20:31:04.925989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 296/561] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:04 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1143 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:05.379265 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:05.379906 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:05.385864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:05.386315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:05.387086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:05.387530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:05.510800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:05.519673 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:05.521470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:05.522671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0f524826-82e7-418d-85fa-2ab75d1f0285 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.147363 May 10 20:31:05.523231 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 266/562] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:05 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:05.531608 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:05.532360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:05.538827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:05.539274 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:05.540064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:05.540502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:05.570342 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:05.570787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:05.571228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'fault' on Instance uuid d938abee-70d7-4d66-98a6-5479de0392b2 {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:05.610985 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:05.618127 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0256c6e9-0770-41ac-aefb-169c3789ab2c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 200 len: 1309 microversion: 2.1 time: 0.090365 May 10 20:31:05.618733 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 297/563] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:05 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:05.944460 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:05.945121 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:05.951163 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:05.951620 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:05.952396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:05.952835 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:06.032132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:06.039678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c09cfc93-1ba7-4cc3-a548-3a6183bcbe00 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1135 microversion: 2.1 time: 0.100680 May 10 20:31:06.040258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 267/564] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:05 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1135 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:06.540530 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:06.541326 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:06.548509 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:06.549007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:06.549796 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:06.550240 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:06.637258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:06.638671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: d938abee-70d7-4d66-98a6-5479de0392b2] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:06.646356 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:06.646800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:06.647593 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:06.648017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:06.662764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] HTTP exception thrown: Instance d938abee-70d7-4d66-98a6-5479de0392b2 could not be found. May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Request method failure captured: May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 HTTP/1.1 May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiessnrbMpA13JMeIYTRZo_xYxazrERqQwR10JlUAtyv0XU7mYWrTmm_-fdUTc5GNInPD5HCVfMcufqol0hNYScp5_J4aEKuC-9aNWDdmlWiJD5sv7wVXYf4CetTCSesMdMGtRRpAyTRFqFDudintoRfHOZgwblqzALw3h2CpOeg-BJzY May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: f41df963fc334b24b0ddef0946179bb6 May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1114331992 May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:31:06.664418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f41df963fc334b24b0ddef0946179bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f41df963fc334b24b0ddef0946179bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f41df963fc334b24b0ddef0946179bb6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f41df963fc334b24b0ddef0946179bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesSnapshotTestJSON-1114331992 May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: f41df963fc334b24b0ddef0946179bb6 May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1114331992 May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesSnapshotTestJSON-1114331992-project May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 7c4fb8aded0e4f62a7e67e9bd23b81b1 May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesSnapshotTestJSON-1114331992-project May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance d938abee-70d7-4d66-98a6-5479de0392b2 could not be found. May 10 20:31:06.665865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'd938abee-70d7-4d66-98a6-5479de0392b2'} May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d938abee-70d7-4d66-98a6-5479de0392b2 could not be found. May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:31:06.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d938abee-70d7-4d66-98a6-5479de0392b2 could not be found. May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d938abee-70d7-4d66-98a6-5479de0392b2 could not be found. May 10 20:31:06.668111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:06.670556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Returning 404 to user: Instance d938abee-70d7-4d66-98a6-5479de0392b2 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:31:06.670556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fba9f3b1-7c53-436a-9406-75502fcae3ac tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2" status: 404 len: 111 microversion: 2.1 time: 0.033879 May 10 20:31:06.670556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 268/565] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:06 2022] GET /compute/v2.1/servers/d938abee-70d7-4d66-98a6-5479de0392b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:31:06.686841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:06.695569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:06.697083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:06.698266 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-169ae23d-0098-4bf5-90c6-411bffd90678 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.161548 May 10 20:31:06.699320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 298/566] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:06 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:07.058240 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:07.059919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:07.067606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:07.068057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:07.069441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:07.070330 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:07.221356 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:07.228930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fcadadef-e799-474f-a583-f409e274a9be tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1277 microversion: 2.1 time: 0.175128 May 10 20:31:07.229657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 269/567] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:07 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:07.266056 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:07.266614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:07.273918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:07.274296 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:07.275079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:07.275522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:07.396351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lazy-loading 'services' on Instance uuid 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:07.508320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-08872cc5-23fc-4906-90e6-8d59ee817897 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-volume_attachments/6c2aed25-9193-40d2-9ff0-b68cb9ade334" status: 202 len: 0 microversion: 2.1 time: 0.245570 May 10 20:31:07.508524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 299/568] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:31:07 2022] DELETE /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-volume_attachments/6c2aed25-9193-40d2-9ff0-b68cb9ade334 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:31:07.717768 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:07.718436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:07.725234 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:07.725681 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:07.726445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:07.726882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:07.858152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:07.868632 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:07.870267 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:07.871416 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-65b219ef-c172-4490-844f-46dfe4a67f3d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.157532 May 10 20:31:07.871992 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 270/569] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:07 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:08.246576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:08.247311 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:08.253523 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:08.253980 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:08.254754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:08.255196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:08.380082 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:08.387380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1a4da0e3-2ade-4431-a5e3-02a35f81893e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.145499 May 10 20:31:08.387973 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 300/570] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:08 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:08.889172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:08.889941 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:08.896440 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:08.897218 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:08.898001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:08.898792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:09.029678 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:09.038316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:09.039929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:09.041115 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-222cf080-6037-4ff0-9c92-4716eed32cac tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.155846 May 10 20:31:09.041673 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 271/571] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:08 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:09.405273 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:09.405990 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:09.413039 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:09.413442 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:09.414226 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:09.414673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:09.444458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-de462876-b925-4048-a282-2e4503d365ec req-b32f8308-1c3e-48ad-8a43-6f4204ee9066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9", "tag": "ef5b3996-8a16-4831-b6f6-94b31b5af88d"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:09.458277 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-de462876-b925-4048-a282-2e4503d365ec req-b32f8308-1c3e-48ad-8a43-6f4204ee9066 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:09.458772 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-de462876-b925-4048-a282-2e4503d365ec req-b32f8308-1c3e-48ad-8a43-6f4204ee9066 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:09.478342 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-de462876-b925-4048-a282-2e4503d365ec req-b32f8308-1c3e-48ad-8a43-6f4204ee9066 service nova] Creating event network-changed:ef5b3996-8a16-4831-b6f6-94b31b5af88d for instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 on hv-cinder-82880 May 10 20:31:09.484309 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-de462876-b925-4048-a282-2e4503d365ec req-b32f8308-1c3e-48ad-8a43-6f4204ee9066 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043378 May 10 20:31:09.484846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 272/572] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:31:09.558069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:09.566311 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ea1554d3-57c9-437b-a815-5c7a03ade150 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.164875 May 10 20:31:09.566961 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 301/573] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:09 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:10.060622 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:10.061341 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:10.068149 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:10.068538 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:10.069340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:10.069779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:10.202464 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:10.211297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:10.212790 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:10.213967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f55664a7-e8c4-4f7b-8e02-e557fd76e9a0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.158052 May 10 20:31:10.214522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 273/574] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:10 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:10.586354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:10.587025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:10.593715 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:10.594163 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:10.595000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:10.595439 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:10.720675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cea5f8cf-b4c2-4615-9d34-1c615021e8ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:10.726947 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cea5f8cf-b4c2-4615-9d34-1c615021e8ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:10.727603 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cea5f8cf-b4c2-4615-9d34-1c615021e8ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:10.741596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:10.749209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b50dfb1b-2f95-4bb3-aca0-33efd1e8ccdc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.168398 May 10 20:31:10.753005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 302/575] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:10 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:10.789371 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cea5f8cf-b4c2-4615-9d34-1c615021e8ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Going to try to stop instance {{(pid=117260) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 20:31:10.831285 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cea5f8cf-b4c2-4615-9d34-1c615021e8ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action" status: 202 len: 0 microversion: 2.1 time: 0.114806 May 10 20:31:10.831890 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 274/576] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:31:10 2022] POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:31:10.840344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:10.841177 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:10.848512 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:10.849224 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:10.850259 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:10.850706 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:10.983216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:10.991777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c71ee43d-af0c-48e3-85e6-4e16560df6f2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.155501 May 10 20:31:10.992359 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 303/577] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:10 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:11.233542 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:11.234232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:11.241887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:11.242560 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:11.243329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:11.243911 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:11.377112 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:11.385630 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:11.387117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:11.388295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9b96e30f-12f7-4c96-9bc4-8fb3f79a8332 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.159691 May 10 20:31:11.388860 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 275/578] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:11 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:11.765193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:11.765808 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:11.773114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:11.773569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:11.774337 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:11.774774 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:11.903267 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:11.910454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e652f72a-3cea-4c19-9c8e-b61f02c36958 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.149105 May 10 20:31:11.911013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 304/579] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:11 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:12.009067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:12.009733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:12.015689 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:12.016082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:12.016852 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:12.017316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:12.144516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:12.152215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f71e10cd-2aa2-4388-bcb4-1939650ed360 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.147020 May 10 20:31:12.152786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 276/580] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:12 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:12.407605 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:12.408224 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:12.414183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:12.414638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:12.415407 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:12.415846 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:12.539670 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:12.548532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:12.550080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:12.551246 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5c16db8c-297b-4d29-9e21-cc162df7e3e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.148162 May 10 20:31:12.551811 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 305/581] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:12 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:12.927407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:12.928015 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:12.934565 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:12.935013 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:12.935780 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:12.936211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:13.066027 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:13.073311 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4b32b8cb-ff40-48bb-a4ef-0e682009eb29 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.149672 May 10 20:31:13.073877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 277/582] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:12 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:13.169690 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:13.170305 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:13.177354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:13.177865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:13.178590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:13.179032 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:13.312401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:13.319652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-aa2e0feb-9525-424f-968c-3d668bfd5301 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.153850 May 10 20:31:13.320217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 306/583] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:13 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:13.569452 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:13.570133 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:13.576011 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:13.576455 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:13.577233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:13.577663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:13.700527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:13.709518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:13.711019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:13.712169 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-eb392805-862c-4dcc-b809-93276d47a033 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.146678 May 10 20:31:13.712718 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 278/584] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:13 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:14.090211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:14.090829 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:14.096848 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:14.097330 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:14.098105 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:14.098546 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:14.227323 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:14.234777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-89675b7a-b057-44cd-a9e9-048350ec0808 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.148379 May 10 20:31:14.235832 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 307/585] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:14 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:14.336639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:14.337295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:14.343802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:14.344289 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:14.345846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:14.346299 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:14.477504 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:14.484775 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c53f3a21-7030-4fe4-92da-71a73103d409 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.151942 May 10 20:31:14.486085 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 279/586] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:14 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:14.730763 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:14.731403 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:14.738175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:14.738579 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:14.739355 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:14.739799 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:14.863968 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:14.872202 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:14.873761 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:14.874923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9b7edae8-41c2-47f0-bb74-63b3ad4eec12 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.148148 May 10 20:31:14.875522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 308/587] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:14 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:15.252498 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:15.253146 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:15.259099 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.259547 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:15.260314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.260751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:15.393227 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:15.402434 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6024149e-89ab-4650-ad5f-817d3f22c9db tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.154238 May 10 20:31:15.402984 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 280/588] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:15 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:15.490353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-788341411", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "networks": [{"uuid": "4cab43d7-cfde-4a61-889f-4f2ce520f079"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:15.503250 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:15.504010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:15.510722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.511132 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:15.512066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.512605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:15.547247 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] validate_networks() for [('4cab43d7-cfde-4a61-889f-4f2ce520f079', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:31:15.722749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:15.730191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6d8a9f75-87f5-4c0b-90be-17f40cb87fe4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.231878 May 10 20:31:15.730967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 281/589] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:15 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:15.893285 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:15.893918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:15.899944 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.900386 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:15.901173 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.901606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:15.978980 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:31:15.979565 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:31:15.980067 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:31:15.980641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:31:15.981072 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:31:15.990521 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.991070 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:15.991750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:15.992185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:16.008208 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Getting quotas for project f41df963fc334b24b0ddef0946179bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:31:16.012050 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Getting quotas for user 7c4fb8aded0e4f62a7e67e9bd23b81b1 and project f41df963fc334b24b0ddef0946179bb6. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:31:16.023514 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:31:16.025871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:31:16.041693 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:16.050638 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:16.052137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:16.053530 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-edb52cdf-8f3e-48d7-ba18-5455c9279792 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.164077 May 10 20:31:16.054249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 282/590] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:15 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:31:16.079644 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bf187907-c8c6-4b46-87d5-f8f4956c5d94 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593109 May 10 20:31:16.080281 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 309/591] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:31:16.090095 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7e617b26-0003-4626-8047-169c983a3689 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:16.090716 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7e617b26-0003-4626-8047-169c983a3689 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:16.142760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7e617b26-0003-4626-8047-169c983a3689 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:16.149707 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7e617b26-0003-4626-8047-169c983a3689 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1218 microversion: 2.1 time: 0.063365 May 10 20:31:16.150287 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 283/592] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:16 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:16.420678 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:16.421331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:16.427490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:16.428084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:16.429005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:16.429442 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:16.445157 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-09b26359-6991-4246-9461-9daa7f41d7cd req-e2088063-d2c4-4ae9-9b18-c4c0c1992379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa24eb7-cd9f-4ca7-bad7-5c275879fecd", "name": "network-vif-plugged", "status": "completed", "tag": "d8fb0937-0365-4e3b-b493-e0343c1b6efa"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:16.456294 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-09b26359-6991-4246-9461-9daa7f41d7cd req-e2088063-d2c4-4ae9-9b18-c4c0c1992379 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:16.456964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-09b26359-6991-4246-9461-9daa7f41d7cd req-e2088063-d2c4-4ae9-9b18-c4c0c1992379 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:16.467695 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-09b26359-6991-4246-9461-9daa7f41d7cd req-e2088063-d2c4-4ae9-9b18-c4c0c1992379 service nova] Creating event network-vif-plugged:d8fb0937-0365-4e3b-b493-e0343c1b6efa for instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd on hv-cinder-82880 May 10 20:31:16.473668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-09b26359-6991-4246-9461-9daa7f41d7cd req-e2088063-d2c4-4ae9-9b18-c4c0c1992379 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032979 May 10 20:31:16.474970 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 284/593] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:31:16.564824 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:16.572193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1e2e4310-258d-46f1-bc8c-66c1fc91474a tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.156048 May 10 20:31:16.572763 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 310/594] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:16 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:16.748075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:16.748779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:16.755470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:16.755926 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:16.756702 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:16.757175 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:16.884870 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:16.893060 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5a0d2e05-3ecb-4ddd-9593-c9ed23f14447 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.149163 May 10 20:31:16.893627 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 285/595] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:16 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:17.072449 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:17.073543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:17.082494 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.083035 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:17.084181 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.084800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:17.167174 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:17.167904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:17.174511 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.175177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:17.176041 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.176386 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:17.227135 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:17.235801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:17.237336 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:17.238490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-56eb578f-b30a-45a6-9056-21f1bc3c03de tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.170040 May 10 20:31:17.239055 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 311/596] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:17 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:17.243349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:17.251607 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-313641d6-4632-42ca-b9a1-f524b8751a22 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1270 microversion: 2.1 time: 0.087873 May 10 20:31:17.252161 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 286/597] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:17 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:17.589520 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:17.589899 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:17.596732 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.597201 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:17.597965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.598396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:17.728916 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:17.736808 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0321d34a-23d4-4bf7-8f73-141f639fe7cc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.151339 May 10 20:31:17.737396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 312/598] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:17 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:17.911421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:17.912035 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:17.918429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.918878 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:17.919643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:17.920076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:18.046267 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:18.053994 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f319bddb-069e-4cf6-b229-732c785ef1a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.146397 May 10 20:31:18.054566 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 287/599] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:17 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:18.256684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:18.257243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:18.263276 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:18.263732 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:18.264504 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:18.264939 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:18.267342 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:18.267979 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:18.274192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:18.274717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:18.275493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:18.275927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:18.354376 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:18.373146 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9552733d-b3f3-4913-93ae-177ded524bc8 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1270 microversion: 2.1 time: 0.109453 May 10 20:31:18.378562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 288/600] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:18 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1270 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:18.420679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:18.430114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:18.431604 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:18.432745 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-dde51d74-cf44-4f53-8c23-259392a79100 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.180032 May 10 20:31:18.433352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 313/601] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:18 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:18.753461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:18.754074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:18.760154 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:18.760822 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:18.761799 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:18.762381 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:18.893944 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:18.901779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e3adb0f5-f967-4f7d-a7f2-227cc7b0f689 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.152484 May 10 20:31:18.902346 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 289/602] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:18 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:19.071407 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:19.072017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:19.078295 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.079363 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:19.080139 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.080583 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:19.212801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:19.220425 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c79055c9-3da3-44aa-980c-21c4784d5dbe tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.152723 May 10 20:31:19.224292 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 314/603] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:19 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:19.389725 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:19.390345 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:19.397168 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.397623 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:19.398393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.398836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:19.451026 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:19.451643 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:19.457689 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.458145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:19.458920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.459360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:19.567931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:19.576072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-88730bf3-82dc-4a16-bf60-fe19e9b744bc tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.190161 May 10 20:31:19.576755 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 290/604] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:19 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:19.620763 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:19.630028 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:19.631608 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:19.632779 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9fcf1c15-8702-48be-89da-866532985a1b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.185835 May 10 20:31:19.633530 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 315/605] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:19 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:31:19.919135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:19.919996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:19.928595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.929307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:19.930385 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:19.931037 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.077312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:20.088379 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6e83c15f-1778-4cef-8d69-028c653f0caf tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.172849 May 10 20:31:20.089140 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 291/606] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:19 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:20.240288 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:20.246051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-8e945bd2-18b0-464a-8940-f972c4148b4e req-ac459cb9-36c9-437f-8e61-f87d5153ad97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473a7aa1-a895-4723-9b39-6f8ec8a613a7", "tag": "dc39df93-f122-4732-9e50-a0c9232de4b4"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:20.248716 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:20.258120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:20.258566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.259345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:20.272412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-8e945bd2-18b0-464a-8940-f972c4148b4e req-ac459cb9-36c9-437f-8e61-f87d5153ad97 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:20.273001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-8e945bd2-18b0-464a-8940-f972c4148b4e req-ac459cb9-36c9-437f-8e61-f87d5153ad97 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.278283 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.291435 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-8e945bd2-18b0-464a-8940-f972c4148b4e req-ac459cb9-36c9-437f-8e61-f87d5153ad97 service nova] Creating event network-changed:dc39df93-f122-4732-9e50-a0c9232de4b4 for instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 on hv-cinder-82880 May 10 20:31:20.307173 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-8e945bd2-18b0-464a-8940-f972c4148b4e req-ac459cb9-36c9-437f-8e61-f87d5153ad97 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064605 May 10 20:31:20.311084 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 292/607] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:31:20.423571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:20.430930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4a849dec-706d-41cb-ab21-5f1088dd5506 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.194509 May 10 20:31:20.431501 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 316/608] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:20 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:20.593941 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:20.595275 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:20.601729 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:20.602175 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.602932 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:20.603391 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.653524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:20.655955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:20.668852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:20.669610 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.670583 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:20.671279 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:20.806773 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:20.814920 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-67a30444-4303-4f30-8685-0855941a2cb3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.224822 May 10 20:31:20.815743 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 293/609] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:20 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:20.836201 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:20.847006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:20.848626 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:20.849820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-522f46b1-baeb-485d-8de5-154e31551057 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1810 microversion: 2.20 time: 0.202107 May 10 20:31:20.850396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 317/610] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:20 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:31:21.105805 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:21.106414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:21.112205 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.112647 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:21.113428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.113860 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:21.244893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:21.252605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9d0bf98b-aad5-4f21-9a18-9766385ace96 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.150727 May 10 20:31:21.253314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 294/611] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:21 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:21.449781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:21.450406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:21.457515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.457965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:21.458738 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.459184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:21.603469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:21.614971 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8a232e76-76dd-4265-8426-1c1b545582fd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.170015 May 10 20:31:21.615556 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 318/612] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:21 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:21.831945 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:21.832466 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:21.840155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.840610 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:21.841434 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.841877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:21.867854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:21.868469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:21.874542 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.875002 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:21.876428 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:21.877059 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:22.030793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:22.038574 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-59dc7d42-63bb-47fc-a82a-79af49c9adcf tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.210600 May 10 20:31:22.039150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 295/613] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:21 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:22.055464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:22.064735 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:22.066482 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:22.067649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-eb1ed0f5-9cb1-4bf7-a31a-24fabba0d0e5 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1797 microversion: 2.20 time: 0.203839 May 10 20:31:22.068224 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 319/614] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:31:21 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1797 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:31:22.268705 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:22.269455 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:22.275896 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:22.276460 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:22.277329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:22.277918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:22.419473 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:22.429587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-554cb1f5-abd8-417f-b947-3e6981af1f53 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.164629 May 10 20:31:22.430423 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 296/615] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:22 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:22.484696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-24213a1d-dcce-4bd3-958d-da17209def2c req-fd648182-f9b7-4db1-8b3c-83c4e189db55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9", "name": "network-vif-plugged", "status": "completed", "tag": "ef5b3996-8a16-4831-b6f6-94b31b5af88d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:22.493744 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-24213a1d-dcce-4bd3-958d-da17209def2c req-fd648182-f9b7-4db1-8b3c-83c4e189db55 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:22.494272 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-24213a1d-dcce-4bd3-958d-da17209def2c req-fd648182-f9b7-4db1-8b3c-83c4e189db55 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:22.505941 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-24213a1d-dcce-4bd3-958d-da17209def2c req-fd648182-f9b7-4db1-8b3c-83c4e189db55 service nova] Creating event network-vif-plugged:ef5b3996-8a16-4831-b6f6-94b31b5af88d for instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 on hv-cinder-82880 May 10 20:31:22.511300 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-24213a1d-dcce-4bd3-958d-da17209def2c req-fd648182-f9b7-4db1-8b3c-83c4e189db55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030633 May 10 20:31:22.512206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 320/616] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:31:22.631542 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:22.632291 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:22.637935 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:22.638385 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:22.639150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:22.639584 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:22.794603 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:22.805773 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-52c55448-fcef-46ae-b7cc-7ae8df9e0033 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.177956 May 10 20:31:22.806442 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 297/617] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:22 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:23.058097 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:23.058809 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:23.065888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:23.066343 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:23.067159 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:23.067601 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:23.198996 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:23.206310 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c512dda7-d1a0-4f23-b6e0-ea4796061ec3 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.152610 May 10 20:31:23.206885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 321/618] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:23 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:23.446358 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:23.446976 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:23.453310 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:23.453766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:23.454539 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:23.454980 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:23.582145 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:23.589629 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3485f87e-f2ac-4d11-b5dc-81016e0583d0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.147070 May 10 20:31:23.590213 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 298/619] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:23 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:23.823465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:23.824074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:23.830560 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:23.830950 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:23.831706 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:23.832140 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:23.958375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:23.965666 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4a0134a4-1e7d-4f8d-9591-1ebea37594ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.146149 May 10 20:31:23.966230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 322/620] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:23 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:24.223775 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:24.224394 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:24.230412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:24.230868 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:24.231641 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:24.232086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:24.357729 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:24.364992 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6fd7759e-d1a3-4947-b4e1-fcce9fb76dce tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.145667 May 10 20:31:24.365575 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 299/621] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:24 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:24.606899 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:24.607507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:24.614029 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:24.614474 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:24.615234 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:24.615670 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:24.749252 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:24.757372 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a8ac7e57-19ac-4667-bf15-cfd91bafaf7e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1265 microversion: 2.1 time: 0.154275 May 10 20:31:24.757957 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 323/622] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:24 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:24.983404 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:24.984439 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:24.991675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:24.992240 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:24.993072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:24.993515 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:25.120909 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:25.129766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7492fafc-747d-4016-b983-2331c3706ff9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.150407 May 10 20:31:25.130512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 300/623] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:24 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:25.381927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:25.382547 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:25.389195 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:25.389655 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:25.390431 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:25.391382 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:25.521894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:25.531646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3c59052c-aa1d-47d3-8420-3d5d80800c49 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.153499 May 10 20:31:25.532747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 324/624] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:25 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:25.774229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:25.774755 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:25.780645 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:25.781146 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:25.781913 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:25.782351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:25.909432 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:25.916754 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-37425f7e-cd9a-479e-8ec3-0a9d1c721c4e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1453 microversion: 2.1 time: 0.146684 May 10 20:31:25.917356 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 301/625] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:25 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:25.932484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:25.932997 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:25.939306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:25.939752 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:25.940511 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:25.940949 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:26.065784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:26.073500 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6520662d-8129-40f9-ba7b-7a094d8d7d5e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1453 microversion: 2.1 time: 0.144899 May 10 20:31:26.074073 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 325/626] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:25 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1453 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:26.147737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:26.148346 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:26.156675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:26.157060 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:26.158115 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:26.158559 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:26.289590 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:26.298103 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2b44419d-0560-412f-be39-d84e871fc30d tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1679 microversion: 2.1 time: 0.154447 May 10 20:31:26.298675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 302/627] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:26 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:26.485472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-fa687303-2926-4c8d-9e8f-521fbfddc88d req-8d14cdd0-9783-4a97-9947-99c4e278f58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a7aa1-a895-4723-9b39-6f8ec8a613a7", "name": "network-vif-plugged", "status": "completed", "tag": "dc39df93-f122-4732-9e50-a0c9232de4b4"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:26.497854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-fa687303-2926-4c8d-9e8f-521fbfddc88d req-8d14cdd0-9783-4a97-9947-99c4e278f58f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:26.498426 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-fa687303-2926-4c8d-9e8f-521fbfddc88d req-8d14cdd0-9783-4a97-9947-99c4e278f58f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:26.510638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-fa687303-2926-4c8d-9e8f-521fbfddc88d req-8d14cdd0-9783-4a97-9947-99c4e278f58f service nova] Creating event network-vif-plugged:dc39df93-f122-4732-9e50-a0c9232de4b4 for instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 on hv-cinder-82880 May 10 20:31:26.515955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-fa687303-2926-4c8d-9e8f-521fbfddc88d req-8d14cdd0-9783-4a97-9947-99c4e278f58f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035252 May 10 20:31:26.516859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 326/628] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:31:26.553942 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:26.554711 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:26.561261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:26.561723 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:26.563039 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:26.563487 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:26.716488 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:26.725265 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-82a3f270-422e-4bc1-86c1-9e778d210492 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.179583 May 10 20:31:26.726407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 303/629] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:26 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:27.316193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:27.316919 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:27.323004 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.323469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.324252 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.324699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.454561 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:27.461958 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8df2771b-84c1-4b6e-9d96-a534f775cb52 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1656 microversion: 2.1 time: 0.150136 May 10 20:31:27.462530 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 327/630] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:27 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:27.478785 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-21838447-91b8-4b1b-b4be-bf7f8d56e48b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:27.485921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-21838447-91b8-4b1b-b4be-bf7f8d56e48b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.486374 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-21838447-91b8-4b1b-b4be-bf7f8d56e48b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.508809 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-21838447-91b8-4b1b-b4be-bf7f8d56e48b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Going to try to start instance {{(pid=117260) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 20:31:27.551308 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-21838447-91b8-4b1b-b4be-bf7f8d56e48b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action" status: 202 len: 0 microversion: 2.1 time: 0.076403 May 10 20:31:27.551934 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 304/631] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:31:27 2022] POST /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:31:27.560091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:27.560715 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:27.567209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.567666 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.568445 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.568902 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.697433 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:27.705360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-170bc6e8-c371-4ab9-ba24-d250f9a16b6a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1665 microversion: 2.1 time: 0.149196 May 10 20:31:27.705948 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 328/632] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:27 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:27.742492 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:27.743867 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:27.749960 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.750457 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.751232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.751676 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.827412 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-1ab182e3-ff51-40b5-85d8-dc7e29e8120e req-883c8dd1-e4cf-44e6-a289-9f16373d7680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9", "tag": "ef5b3996-8a16-4831-b6f6-94b31b5af88d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:27.835974 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-1ab182e3-ff51-40b5-85d8-dc7e29e8120e req-883c8dd1-e4cf-44e6-a289-9f16373d7680 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:27.836424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-1ab182e3-ff51-40b5-85d8-dc7e29e8120e req-883c8dd1-e4cf-44e6-a289-9f16373d7680 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:27.848081 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-1ab182e3-ff51-40b5-85d8-dc7e29e8120e req-883c8dd1-e4cf-44e6-a289-9f16373d7680 service nova] Creating event network-changed:ef5b3996-8a16-4831-b6f6-94b31b5af88d for instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 on hv-cinder-82880 May 10 20:31:27.853420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-1ab182e3-ff51-40b5-85d8-dc7e29e8120e req-883c8dd1-e4cf-44e6-a289-9f16373d7680 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029714 May 10 20:31:27.857137 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 329/633] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:31:27.914302 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:27.922479 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4e30dea1-9761-4fae-a2d6-0c2759bef1eb tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1318 microversion: 2.1 time: 0.183548 May 10 20:31:27.923338 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 305/634] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:27 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:28.724168 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:28.725032 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:28.731294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:28.731748 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:28.732533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:28.732993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:28.915233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:28.923588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c724458b-9283-4128-a456-132ae2cd92e0 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1665 microversion: 2.1 time: 0.204708 May 10 20:31:28.924408 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 330/635] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:28 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1665 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:28.939806 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:28.940425 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:28.947036 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:28.947491 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:28.948363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:28.948804 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:29.089838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:29.097827 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a8c21c7a-0455-4df8-b96b-2fac953cd38c tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1508 microversion: 2.1 time: 0.162322 May 10 20:31:29.098403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 306/636] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:28 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:29.117248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6e9aa843-8b5b-4cc0-8ee5-d097037543aa tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "710af596-8baf-432c-ba62-9dc56b886f93", "device": "/dev/sdb"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:29.118367 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6e9aa843-8b5b-4cc0-8ee5-d097037543aa tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:29.127183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e9aa843-8b5b-4cc0-8ee5-d097037543aa tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:29.127734 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e9aa843-8b5b-4cc0-8ee5-d097037543aa tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:29.128582 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e9aa843-8b5b-4cc0-8ee5-d097037543aa tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:29.129143 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6e9aa843-8b5b-4cc0-8ee5-d097037543aa tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:29.370261 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6e9aa843-8b5b-4cc0-8ee5-d097037543aa tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "POST /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259096 May 10 20:31:29.370887 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 331/637] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:31:29 2022] POST /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:31:29.940658 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:29.941306 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:29.947666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:29.948111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:29.948895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:29.949365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:30.076094 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:30.085197 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-986ba3fc-f433-4703-b9d8-7b4203e69ffb tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1665 microversion: 2.1 time: 0.148310 May 10 20:31:30.085776 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 307/638] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:29 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:31.103648 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:31.104346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:31.110528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:31.110982 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:31.111756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:31.112193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:31.234619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:31.241857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f8fbb5f1-7da6-47f0-baaa-85a3feb18af1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1669 microversion: 2.1 time: 0.142904 May 10 20:31:31.242425 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 332/639] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:31 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1669 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:33.083472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ddb14033-d3b8-4629-8fa5-a123998c9e5d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:33.084522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ddb14033-d3b8-4629-8fa5-a123998c9e5d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:33.090955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ddb14033-d3b8-4629-8fa5-a123998c9e5d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:33.091404 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ddb14033-d3b8-4629-8fa5-a123998c9e5d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:33.092201 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ddb14033-d3b8-4629-8fa5-a123998c9e5d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:33.092641 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ddb14033-d3b8-4629-8fa5-a123998c9e5d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:33.162927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ddb14033-d3b8-4629-8fa5-a123998c9e5d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/action" status: 202 len: 0 microversion: 2.1 time: 0.083358 May 10 20:31:33.163834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 308/640] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:31:33 2022] POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:31:33.172340 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:33.173005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:33.179444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:33.179901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:33.180686 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:33.181172 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:33.329550 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:33.337416 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-688d4b00-7dea-4944-9d2b-d99c4c78c020 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1749 microversion: 2.1 time: 0.169421 May 10 20:31:33.337990 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 333/641] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:33 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1749 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:34.356323 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:34.356930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:34.363595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:34.364041 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:34.364803 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:34.365274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:34.503642 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:34.511389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d79c285c-53dc-4c06-9cdd-4ad24dec250b tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.159887 May 10 20:31:34.511953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 309/642] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:34 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:35.529276 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:35.529887 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:35.536244 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:35.536698 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:35.537490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:35.537931 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:35.677840 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:35.685520 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d613ed85-38e3-47ac-b482-81bc4abacd3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.160191 May 10 20:31:35.686114 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 334/643] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:35 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:36.703397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:36.704005 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:36.710418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:36.710858 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:36.711622 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:36.712056 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:36.853857 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:36.861925 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9a5f644d-001d-43ff-8979-adde24c64585 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.162718 May 10 20:31:36.862588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 310/644] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:36 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:37.878801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:37.880065 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:37.887117 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:37.887570 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:37.888341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:37.888784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:38.031688 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:38.039426 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-31076be4-2dfb-4a47-9580-0a965208ce3e tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.164364 May 10 20:31:38.039992 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 335/645] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:37 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:39.005809 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cb28a1a4-6720-47aa-b90b-da94201893a6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef02b74c-53ba-4416-8353-7a5345a99dc0"}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:39.006919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cb28a1a4-6720-47aa-b90b-da94201893a6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:39.013337 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cb28a1a4-6720-47aa-b90b-da94201893a6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:39.013791 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cb28a1a4-6720-47aa-b90b-da94201893a6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:39.014559 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cb28a1a4-6720-47aa-b90b-da94201893a6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:39.014996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cb28a1a4-6720-47aa-b90b-da94201893a6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:39.056414 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:39.057052 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:39.063966 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:39.064418 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:39.065220 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:39.065662 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:39.207726 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:39.215965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ddf2d315-4b8e-413d-b920-01308d8bad39 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.163431 May 10 20:31:39.216558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 336/646] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:39 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:40.233707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:40.234258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:40.240592 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:40.241079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:40.241855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:40.242294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:40.378219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:40.386120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-146cb3a5-0831-4ab8-9e60-54fa168b5cad tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.156332 May 10 20:31:40.386696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 337/647] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:40 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:40.548794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cb28a1a4-6720-47aa-b90b-da94201893a6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.546746 May 10 20:31:40.549485 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 311/648] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:31:39 2022] POST /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments => generated 194 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:31:41.403573 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:41.404181 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:41.411384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:41.411887 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:41.412658 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:41.413202 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:41.552961 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:41.560728 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-beb69a56-e471-43ef-960d-b9050166be0a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.161128 May 10 20:31:41.561325 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 338/649] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:41 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:42.578931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:42.579552 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:42.585792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:42.586246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:42.587014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:42.587452 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:42.726146 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:42.734075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c5ce8a61-45ec-44dc-b706-665e05242b29 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.159959 May 10 20:31:42.734642 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 312/650] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:42 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:43.751076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:43.751785 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:43.758028 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:43.758480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:43.759237 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:43.759669 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:43.897008 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:43.904721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-27807bcf-cd06-4f53-a1ae-4ef3440c44ff tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.157544 May 10 20:31:43.905323 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 339/651] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:43 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:44.922773 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:44.923392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:44.929793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:44.930240 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:44.931009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:44.931443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:45.069043 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:45.076680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-13ec23a6-a7c5-4964-a6de-dbd8d8d5cc1a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.158190 May 10 20:31:45.077269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 313/652] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:44 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:46.094711 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:46.095329 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:46.101735 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:46.102192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:46.102964 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:46.103407 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:46.238328 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:46.246183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bc281ee5-e512-4795-8d7d-c1f4ebee4ce0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.155849 May 10 20:31:46.246758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 340/653] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:46 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:47.263562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:47.264200 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:47.270877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:47.271329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:47.272095 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:47.272639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:47.413119 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:47.421083 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3617c4cc-ca7a-4662-b81c-7acc3ea1fe9a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.161342 May 10 20:31:47.422493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 314/654] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:47 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:48.019395 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:48.020659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:48.026920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.027373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.028173 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.028610 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.051149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lazy-loading 'flavor' on Instance uuid 47fb1639-3b60-43d2-8dfe-60110e829a8d {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:48.169133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4bcae404-b5a3-4564-90f5-0233bc3f3f1b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/action" status: 200 len: 32 microversion: 2.1 time: 0.154001 May 10 20:31:48.169658 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 341/655] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:31:48 2022] POST /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/action => generated 32 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:31:48.179296 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:48.179900 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:48.186117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.186595 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.187403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.187927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.316988 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:48.324728 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5d8add9d-538c-4e9f-ac01-0292686931f8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.149490 May 10 20:31:48.325327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 315/656] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:48 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:48.441966 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:48.442740 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:48.448751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.449250 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.450001 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.450436 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.593074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:48.601150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-706b0dc6-83c5-4ba3-8a84-c0198c6ae1f4 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.164052 May 10 20:31:48.601724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 342/657] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:48 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:48.633429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:48.634021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:48.639962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.640484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.641292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:48.641732 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:48.719667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lazy-loading 'services' on Instance uuid 473a7aa1-a895-4723-9b39-6f8ec8a613a7 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:31:48.791536 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f718504f-4c4f-4dcb-8ad6-5dd38091068b tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7/os-volume_attachments/710af596-8baf-432c-ba62-9dc56b886f93" status: 202 len: 0 microversion: 2.1 time: 0.161842 May 10 20:31:48.792121 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 316/658] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:31:48 2022] DELETE /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7/os-volume_attachments/710af596-8baf-432c-ba62-9dc56b886f93 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:31:49.342197 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:49.342724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:49.349677 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:49.350137 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:49.350911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:49.351354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:49.473713 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:49.481376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-16ec19f0-e97e-4a93-bdd6-cc25b6c23d4f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.143099 May 10 20:31:49.481967 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 343/659] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:49 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:49.619075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:49.619795 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:49.626728 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:49.627184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:49.627971 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:49.628410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:49.768999 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:49.776955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b07fbe8f-cfa8-483e-86d8-46d7568eeab0 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.162095 May 10 20:31:49.777541 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 317/660] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:49 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:31:50.498740 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:50.499347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:50.505819 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:50.506265 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:50.507021 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:50.507454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:50.635282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:50.644937 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bd934fdf-c8bd-430d-9303-9aa3a997e0ec tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.150018 May 10 20:31:50.645806 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 344/661] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:50 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:50.794197 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:50.794722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:50.801626 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:50.802074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:50.802845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:50.803283 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:50.939950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:50.947882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-57cc3181-e673-423a-8a39-0efb9ff27984 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.157589 May 10 20:31:50.948446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 318/662] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:50 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:50.951026 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:50.951555 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:50.958657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:50.959105 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:50.959964 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:50.960423 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:50.986351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:31:51.058152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7a675181-8e4e-42cf-983d-00f28f3c3efd tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "DELETE /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 204 len: 0 microversion: 2.1 time: 0.110655 May 10 20:31:51.058838 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 345/663] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:31:50 2022] DELETE /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:31:51.066699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:51.067388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:51.073232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:51.073686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:51.074456 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:51.074892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:51.202732 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:51.210592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4563b50d-e65b-4dad-af25-3873de6b46f1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1514 microversion: 2.1 time: 0.147681 May 10 20:31:51.211158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 319/664] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:51 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:51.662731 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:51.663433 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:51.669939 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:51.670393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:51.671175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:51.671620 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:51.797241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:51.805507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-21b52f57-ad41-4faa-a1cb-13ccf291ab4a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.147086 May 10 20:31:51.806086 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 346/665] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:51 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:51.964365 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:51.964994 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:51.971897 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:51.972343 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:51.973139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:51.973572 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:52.112354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:52.120216 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1ddf4638-325f-4ce5-b02a-61344de352c9 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.159605 May 10 20:31:52.120794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 320/666] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:51 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:52.227545 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:52.228074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:52.234160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:52.234613 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:52.236045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:52.236489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:52.357319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:52.364490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-883bdd84-a2b1-4e3d-af2e-c262346006a1 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1514 microversion: 2.1 time: 0.140833 May 10 20:31:52.365088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 347/667] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:52 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1514 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:52.822996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:52.823600 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:52.830097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:52.830546 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:52.831307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:52.831738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:52.955183 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:52.963130 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0f58085e-06a2-41b7-8eff-f2ca32d052b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.143976 May 10 20:31:52.963701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 321/668] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:52 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:53.137291 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:53.137900 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:53.144757 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:53.145490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:53.146249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:53.146777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:53.286868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:53.294619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-700bf1a5-237e-4cbd-a153-ee3a598bbe8a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.161217 May 10 20:31:53.295199 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 348/669] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:53 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:53.380397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:53.381036 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:53.387516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:53.387926 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:53.388693 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:53.389175 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:53.512446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c4fb8aded0e4f62a7e67e9bd23b81b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41df963fc334b24b0ddef0946179bb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:53.520747 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ceeff68b-1ad6-46aa-86bd-b52db90eee6a tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 200 len: 1514 microversion: 2.1 time: 0.143864 May 10 20:31:53.521356 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 322/670] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:53 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:53.915210 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-c6ebc902-dbd5-47d9-abb7-9e6bf4ff921b req-def4cdce-3c30-46d3-a12c-24663f2e749a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a7aa1-a895-4723-9b39-6f8ec8a613a7", "name": "network-vif-deleted", "tag": "dc39df93-f122-4732-9e50-a0c9232de4b4"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:31:53.923676 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-c6ebc902-dbd5-47d9-abb7-9e6bf4ff921b req-def4cdce-3c30-46d3-a12c-24663f2e749a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:53.924116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-c6ebc902-dbd5-47d9-abb7-9e6bf4ff921b req-def4cdce-3c30-46d3-a12c-24663f2e749a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:53.934834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-c6ebc902-dbd5-47d9-abb7-9e6bf4ff921b req-def4cdce-3c30-46d3-a12c-24663f2e749a service nova] Creating event network-vif-deleted:dc39df93-f122-4732-9e50-a0c9232de4b4 for instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 on hv-cinder-82880 May 10 20:31:53.940123 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-c6ebc902-dbd5-47d9-abb7-9e6bf4ff921b req-def4cdce-3c30-46d3-a12c-24663f2e749a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028510 May 10 20:31:53.940696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 349/671] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:31:53.983660 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:53.984271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:53.990705 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:53.991146 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:53.991908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:53.992340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:54.125681 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:54.134072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bea09ed3-155c-43e3-89d0-704e84f98117 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.154341 May 10 20:31:54.134636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 323/672] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:53 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:54.312613 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:54.313269 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:54.319430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:54.319884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:54.320657 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:54.321146 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:54.464533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:54.472993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9ef57d7b-ce44-4613-83ea-c7fb0c4bed05 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1754 microversion: 2.1 time: 0.165121 May 10 20:31:54.473599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 350/673] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:54 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:54.538418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:54.539038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] [instance: 473a7aa1-a895-4723-9b39-6f8ec8a613a7] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:54.545434 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:54.545886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:54.546658 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:54.547091 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:54.561002 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] HTTP exception thrown: Instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 could not be found. May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Request method failure captured: May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 HTTP/1.1 May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiessnrbMpA13JMeIYTRZo_xYxazrERqQwR10JlUAtyv0XU7mYWrTmm_-fdUTc5GNInPD5HCVfMcufqol0hNYScp5_J4aEKuC-9aNWDdmlWiJD5sv7wVXYf4CetTCSesMdMGtRRpAyTRFqFDudintoRfHOZgwblqzALw3h2CpOeg-BJzY May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: f41df963fc334b24b0ddef0946179bb6 May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1114331992 May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:31:54.562687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f41df963fc334b24b0ddef0946179bb6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f41df963fc334b24b0ddef0946179bb6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f41df963fc334b24b0ddef0946179bb6", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f41df963fc334b24b0ddef0946179bb6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesSnapshotTestJSON-1114331992 May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: f41df963fc334b24b0ddef0946179bb6 May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1114331992 May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesSnapshotTestJSON-1114331992-project May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 7c4fb8aded0e4f62a7e67e9bd23b81b1 May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesSnapshotTestJSON-1114331992-project May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 could not be found. May 10 20:31:54.564211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '473a7aa1-a895-4723-9b39-6f8ec8a613a7'} May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 could not be found. May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:31:54.564953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 could not be found. May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 could not be found. May 10 20:31:54.566219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:31:54.567304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] Returning 404 to user: Instance 473a7aa1-a895-4723-9b39-6f8ec8a613a7 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:31:54.567304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f1040f9e-b749-48e6-a43f-cdaca33da6b0 tempest-VolumesSnapshotTestJSON-1114331992 tempest-VolumesSnapshotTestJSON-1114331992-project] 10.222.0.61 "GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7" status: 404 len: 111 microversion: 2.1 time: 0.029450 May 10 20:31:54.567304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 324/674] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:54 2022] GET /compute/v2.1/servers/473a7aa1-a895-4723-9b39-6f8ec8a613a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:31:55.151653 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:55.152296 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:55.158329 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:55.158783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:55.159558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:55.159998 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:55.284482 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:55.292374 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b8921e63-4fb7-4330-b6a5-02313b7632e8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.145199 May 10 20:31:55.292941 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 351/675] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:55 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:55.490485 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:55.491022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:55.496874 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:55.497355 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:55.498119 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:55.498559 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:55.636359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:55.644206 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-29d812c1-9aa4-4d95-b133-14e029cb83dc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1757 microversion: 2.1 time: 0.157574 May 10 20:31:55.644763 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 325/676] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:55 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1757 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:56.309312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:56.309944 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:56.316391 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:56.316836 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:56.317624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:56.318060 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:56.447548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:56.455948 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bed3782a-e3fb-476a-bdce-3810b0e6b6b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.150447 May 10 20:31:56.456511 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 352/677] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:56 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:57.472779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:57.473440 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:57.479794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:57.480241 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:57.481026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:57.481469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:57.607158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:57.615428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-beb5fa7c-a581-488d-a3a7-f5f4cb7103a3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.146435 May 10 20:31:57.615992 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 326/678] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:57 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:58.632248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:58.632857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:58.639170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:58.639614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:58.640375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:58.640805 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:58.762795 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:58.772459 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e11f6758-c547-4f8e-a4d1-1660d9d9c9d3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.144050 May 10 20:31:58.773033 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 353/679] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:58 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:31:59.789516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:31:59.790134 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:31:59.796461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:59.796915 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:59.798223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:31:59.798666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:31:59.923157 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:31:59.930807 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d34f2a31-dd2f-4bd3-9bc7-1357ea501617 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.145190 May 10 20:31:59.931372 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 327/680] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:31:59 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:00.948385 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:00.949049 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:00.955294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:00.955747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:00.956517 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:00.956961 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:01.086285 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:01.094175 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6243a118-e8f7-4e8d-8460-652b051ca9c4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.149626 May 10 20:32:01.095269 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 354/681] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:00 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:02.112075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:02.112672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:02.119045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:02.119520 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:02.120286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:02.120724 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:02.259774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:02.267423 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b37e1f1d-137a-499f-ac0a-05a1ee504423 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.159777 May 10 20:32:02.267989 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 328/682] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:02 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:03.284357 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:03.284963 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:03.291233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:03.291686 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:03.292454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:03.292894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:03.417989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:03.425869 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fb833054-eb3d-46b9-b0a8-7b4c83d6edd4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.145440 May 10 20:32:03.426444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 355/683] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:03 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:04.442304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:04.442921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:04.449297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:04.449753 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:04.450526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:04.450966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:04.575166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:04.583384 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8adb606e-82b4-475d-a457-6226e92e44b4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.144970 May 10 20:32:04.583990 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 329/684] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:04 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:05.600859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:05.601524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:05.607787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:05.608265 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:05.609071 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:05.609508 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:05.735708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:05.743624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-90b61313-eee5-4c6f-a180-b720a49d54eb tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.146586 May 10 20:32:05.744209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 356/685] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:05 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:06.760715 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:06.761351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:06.767701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:06.768153 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:06.768924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:06.769389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:06.893508 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:06.901520 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8d802ab3-fad9-4822-a5d8-c7ef1e4d3c14 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.144694 May 10 20:32:06.902091 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 330/686] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:06 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:07.918374 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:07.918978 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:07.926069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:07.926519 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:07.927280 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:07.927721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:08.051872 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:08.059613 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-205cd672-12e1-4a28-a351-ece9947873f4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.145056 May 10 20:32:08.060187 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 357/687] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:07 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:09.076363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:09.076964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:09.083216 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:09.083663 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:09.084427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:09.084860 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:09.457999 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:09.465674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-efce449b-561a-4c69-927b-3e17b516ee56 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.393080 May 10 20:32:09.466238 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 331/688] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:09 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:10.483143 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:10.483783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:10.490093 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:10.490539 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:10.491302 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:10.491734 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:10.616991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:10.624927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c89ae344-74a1-4d30-b7b0-b70c2f915515 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.145600 May 10 20:32:10.625598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 358/689] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:10 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:11.641920 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:11.642564 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:11.649191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:11.649639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:11.650403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:11.650839 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:11.777697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:11.785466 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-39ded395-5b86-4c39-95ac-35e91f5eb270 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1735 microversion: 2.1 time: 0.148062 May 10 20:32:11.786052 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 332/690] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:11 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:12.803110 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:12.803719 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:12.810106 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:12.810551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:12.811315 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:12.811748 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:12.942477 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:12.950818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7e5ef586-05e4-4625-9f5b-3078290fe6d8 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1715 microversion: 2.1 time: 0.151445 May 10 20:32:12.951537 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 359/691] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:12 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:13.056092 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:13.056573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:13.062954 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:13.063401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:13.064224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:13.064667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:13.141771 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] HTTP exception thrown: Cannot 'detach_volume' instance 47fb1639-3b60-43d2-8dfe-60110e829a8d while it is in vm_state rescued May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Request method failure captured: May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments/ef02b74c-53ba-4416-8353-7a5345a99dc0 HTTP/1.1 May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesq0Vc_JFx25RDdGrab6G1Iqu_JtPPyOBfXB8fkoV9jcyK650upwuLU5hG6oDEdqSuuvbiquU2zsKAUQg3ZRDYCridJB_yYopyk0JTkLq68JtvfMdR6Gly2BpmcpOsEo14_p6IHGfWiEfacS-oEsbkwH3bvVn6fY4ezHZcjBsuf-y7g May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:32:13.143304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67dae2f388bc4a81bc957f48b1b02e42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: df3cf8a2f7c54b80aac61d6ca59672b5 May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:32:13.145172 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Cannot 'detach_volume' instance 47fb1639-3b60-43d2-8dfe-60110e829a8d while it is in vm_state rescued May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'server_id': '47fb1639-3b60-43d2-8dfe-60110e829a8d', 'id': 'ef02b74c-53ba-4416-8353-7a5345a99dc0'} May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 47fb1639-3b60-43d2-8dfe-60110e829a8d in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:32:13.145974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 47fb1639-3b60-43d2-8dfe-60110e829a8d while it is in vm_state rescued May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 47fb1639-3b60-43d2-8dfe-60110e829a8d while it is in vm_state rescued May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:32:13.147382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Returning 409 to user: Cannot 'detach_volume' instance 47fb1639-3b60-43d2-8dfe-60110e829a8d while it is in vm_state rescued {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:32:13.149075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f1cb3a5a-9fe6-4b46-bcdd-d68eddef40f1 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments/ef02b74c-53ba-4416-8353-7a5345a99dc0" status: 409 len: 152 microversion: 2.1 time: 0.092738 May 10 20:32:13.149075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 333/692] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:32:13 2022] DELETE /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments/ef02b74c-53ba-4416-8353-7a5345a99dc0 => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 20:32:13.153934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d5a092f8-0589-4deb-9c2e-c9935b130bf4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:13.154477 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d5a092f8-0589-4deb-9c2e-c9935b130bf4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:13.163658 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5a092f8-0589-4deb-9c2e-c9935b130bf4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:13.164306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5a092f8-0589-4deb-9c2e-c9935b130bf4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:13.165096 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5a092f8-0589-4deb-9c2e-c9935b130bf4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:13.165543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d5a092f8-0589-4deb-9c2e-c9935b130bf4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:13.231703 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d5a092f8-0589-4deb-9c2e-c9935b130bf4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "POST /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/action" status: 202 len: 0 microversion: 2.1 time: 0.081402 May 10 20:32:13.232391 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 360/693] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:32:13 2022] POST /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:32:13.241093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:13.241710 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:13.247597 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:13.248051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:13.248875 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:13.249435 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:13.378325 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:13.386358 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c2da7e62-4731-4586-b0c7-4858951ae959 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1723 microversion: 2.1 time: 0.149128 May 10 20:32:13.386929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 334/694] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:13 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:14.405750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:14.406577 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:14.413407 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:14.413855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:14.414620 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:14.415052 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:14.594360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:14.602168 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-781a4c2d-ec9a-4ec1-89db-306f4ff8e279 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1723 microversion: 2.1 time: 0.201247 May 10 20:32:14.602739 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 361/695] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:14 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:15.619699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:15.620257 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:15.627283 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:15.627712 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:15.628486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:15.628926 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:15.755852 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:15.763604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fa71e734-aed1-4c51-bfb7-9d4fd157915b tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1723 microversion: 2.1 time: 0.147793 May 10 20:32:15.764259 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 335/696] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:15 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:16.780960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:16.781607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:16.787851 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:16.788298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:16.789090 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:16.789525 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:16.914914 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:16.922587 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-37ffd3b9-751e-43e8-8bd8-bb136d991ce6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1729 microversion: 2.1 time: 0.145486 May 10 20:32:16.923154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 362/697] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:16 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1729 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:16.939312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4f44b8f1-5eef-4fb8-90e6-c16b6a8be042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:16.939836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4f44b8f1-5eef-4fb8-90e6-c16b6a8be042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:16.946118 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f44b8f1-5eef-4fb8-90e6-c16b6a8be042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:16.946589 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f44b8f1-5eef-4fb8-90e6-c16b6a8be042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:16.947360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f44b8f1-5eef-4fb8-90e6-c16b6a8be042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:16.947802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f44b8f1-5eef-4fb8-90e6-c16b6a8be042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:17.072767 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4f44b8f1-5eef-4fb8-90e6-c16b6a8be042 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137732 May 10 20:32:17.073408 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 336/698] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:32:16 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:18.003356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-0d18114e-3785-4147-905d-83b770350dd3 req-5c38b294-0d66-467e-b24b-540f246d49db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47fb1639-3b60-43d2-8dfe-60110e829a8d", "tag": "47de41f7-9f27-4859-b152-66f1ab4268f4"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:18.013980 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0d18114e-3785-4147-905d-83b770350dd3 req-5c38b294-0d66-467e-b24b-540f246d49db service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:18.014818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0d18114e-3785-4147-905d-83b770350dd3 req-5c38b294-0d66-467e-b24b-540f246d49db service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:18.039534 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-0d18114e-3785-4147-905d-83b770350dd3 req-5c38b294-0d66-467e-b24b-540f246d49db service nova] Creating event network-changed:47de41f7-9f27-4859-b152-66f1ab4268f4 for instance 47fb1639-3b60-43d2-8dfe-60110e829a8d on hv-cinder-82880 May 10 20:32:18.045037 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-0d18114e-3785-4147-905d-83b770350dd3 req-5c38b294-0d66-467e-b24b-540f246d49db service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045398 May 10 20:32:18.046054 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 363/699] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:20.059320 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-39e1ee60-4707-4b2d-8e17-4fc326533098 req-a741b06d-397a-41ef-8cac-8ba0c50c7c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47fb1639-3b60-43d2-8dfe-60110e829a8d", "tag": "47de41f7-9f27-4859-b152-66f1ab4268f4"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:20.067920 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-39e1ee60-4707-4b2d-8e17-4fc326533098 req-a741b06d-397a-41ef-8cac-8ba0c50c7c4a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:20.068364 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-39e1ee60-4707-4b2d-8e17-4fc326533098 req-a741b06d-397a-41ef-8cac-8ba0c50c7c4a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:20.079063 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-39e1ee60-4707-4b2d-8e17-4fc326533098 req-a741b06d-397a-41ef-8cac-8ba0c50c7c4a service nova] Creating event network-changed:47de41f7-9f27-4859-b152-66f1ab4268f4 for instance 47fb1639-3b60-43d2-8dfe-60110e829a8d on hv-cinder-82880 May 10 20:32:20.084008 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-39e1ee60-4707-4b2d-8e17-4fc326533098 req-a741b06d-397a-41ef-8cac-8ba0c50c7c4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028813 May 10 20:32:20.084571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 337/700] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:20.972630 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-cad7d6a1-de51-4605-bf0f-4bc6c10fdf98 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:20.973243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-cad7d6a1-de51-4605-bf0f-4bc6c10fdf98 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:20.979584 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cad7d6a1-de51-4605-bf0f-4bc6c10fdf98 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:20.980037 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cad7d6a1-de51-4605-bf0f-4bc6c10fdf98 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:20.980838 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cad7d6a1-de51-4605-bf0f-4bc6c10fdf98 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:20.981312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cad7d6a1-de51-4605-bf0f-4bc6c10fdf98 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:21.009810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-cad7d6a1-de51-4605-bf0f-4bc6c10fdf98 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments/c3c50a5d-349c-477e-9801-48bb3d7bf66c" status: 200 len: 194 microversion: 2.20 time: 0.042124 May 10 20:32:21.010384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 364/701] 10.222.0.61 () {60 vars in 1453 bytes} [Tue May 10 20:32:20 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments/c3c50a5d-349c-477e-9801-48bb3d7bf66c => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:32:21.076456 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:21.077067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:21.083303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:21.083749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:21.084507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:21.084939 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:21.164196 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lazy-loading 'services' on Instance uuid daa24eb7-cd9f-4ca7-bad7-5c275879fecd {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:32:21.232568 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-87e7dee8-5bca-421c-9e79-66391b0568b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments/c3c50a5d-349c-477e-9801-48bb3d7bf66c" status: 202 len: 0 microversion: 2.20 time: 0.160554 May 10 20:32:21.233240 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 338/702] 10.222.0.61 () {60 vars in 1456 bytes} [Tue May 10 20:32:21 2022] DELETE /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments/c3c50a5d-349c-477e-9801-48bb3d7bf66c => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:32:21.245319 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-41ac5a05-fd3c-489c-9b2d-939cebce574a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:21.246242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-41ac5a05-fd3c-489c-9b2d-939cebce574a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:21.253064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41ac5a05-fd3c-489c-9b2d-939cebce574a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:21.253460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41ac5a05-fd3c-489c-9b2d-939cebce574a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:21.254324 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41ac5a05-fd3c-489c-9b2d-939cebce574a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:21.254764 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-41ac5a05-fd3c-489c-9b2d-939cebce574a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:21.288811 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-41ac5a05-fd3c-489c-9b2d-939cebce574a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049455 May 10 20:32:21.289396 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 365/703] 10.222.0.61 () {60 vars in 1342 bytes} [Tue May 10 20:32:21 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:32:22.302081 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a97df035-a6b7-4c9a-b37e-d22b4ae89b06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:22.303010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a97df035-a6b7-4c9a-b37e-d22b4ae89b06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:22.309204 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a97df035-a6b7-4c9a-b37e-d22b4ae89b06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:22.309662 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a97df035-a6b7-4c9a-b37e-d22b4ae89b06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:22.310437 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a97df035-a6b7-4c9a-b37e-d22b4ae89b06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:22.310879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a97df035-a6b7-4c9a-b37e-d22b4ae89b06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:22.339090 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a97df035-a6b7-4c9a-b37e-d22b4ae89b06 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042436 May 10 20:32:22.339633 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 339/704] 10.222.0.61 () {60 vars in 1342 bytes} [Tue May 10 20:32:22 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:22.394514 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:22.395246 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:22.401501 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:22.401956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:22.402724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:22.403160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:22.427942 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:32:22.501933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2904c171-9aeb-416c-9e9d-95885559f54f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 204 len: 0 microversion: 2.20 time: 0.111479 May 10 20:32:22.502559 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 366/705] 10.222.0.61 () {60 vars in 1279 bytes} [Tue May 10 20:32:22 2022] DELETE /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:32:22.511175 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:22.511788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:22.518183 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:22.518636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:22.519410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:22.520115 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:22.644588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:22.652565 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:22.654122 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:22.655264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1e28d05d-9caa-494d-8f44-86b8d393101f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.148079 May 10 20:32:22.655894 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 340/706] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:22 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:32:23.674784 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:23.675489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:23.681544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:23.681992 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:23.682765 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:23.683207 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:23.808721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:23.817090 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:23.818630 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:23.819786 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-23d779b0-2abd-4763-82b5-fe35f14be2ce tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.149508 May 10 20:32:23.820347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 367/707] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:23 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:24.837833 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:24.838575 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:24.845621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:24.846147 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:24.846990 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:24.847499 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:24.985786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:24.996546 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:24.998184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:24.999470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5113ebb9-32c5-41db-b3c1-38daa64cf8b6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1725 microversion: 2.20 time: 0.165691 May 10 20:32:25.009215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 341/708] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:24 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:25.486858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-278d97bb-0977-46a9-ab4b-4a6e1d6ba7e3 req-fd840980-f990-45e1-a113-41189b4f847b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daa24eb7-cd9f-4ca7-bad7-5c275879fecd", "name": "network-vif-deleted", "tag": "d8fb0937-0365-4e3b-b493-e0343c1b6efa"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:25.495606 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-278d97bb-0977-46a9-ab4b-4a6e1d6ba7e3 req-fd840980-f990-45e1-a113-41189b4f847b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:25.496045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-278d97bb-0977-46a9-ab4b-4a6e1d6ba7e3 req-fd840980-f990-45e1-a113-41189b4f847b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:25.507840 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-278d97bb-0977-46a9-ab4b-4a6e1d6ba7e3 req-fd840980-f990-45e1-a113-41189b4f847b service nova] Creating event network-vif-deleted:d8fb0937-0365-4e3b-b493-e0343c1b6efa for instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd on hv-cinder-82880 May 10 20:32:25.513966 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-278d97bb-0977-46a9-ab4b-4a6e1d6ba7e3 req-fd840980-f990-45e1-a113-41189b4f847b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031191 May 10 20:32:25.514607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 368/709] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:25.879238 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2cdc7213-80d7-4826-8dd0-91fbba70f183 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:25.880227 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2cdc7213-80d7-4826-8dd0-91fbba70f183 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:25.887667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2cdc7213-80d7-4826-8dd0-91fbba70f183 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:25.888125 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2cdc7213-80d7-4826-8dd0-91fbba70f183 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:25.889182 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2cdc7213-80d7-4826-8dd0-91fbba70f183 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:25.889623 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2cdc7213-80d7-4826-8dd0-91fbba70f183 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:25.926861 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2cdc7213-80d7-4826-8dd0-91fbba70f183 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052337 May 10 20:32:25.929041 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 342/710] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:32:25 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:32:25.998570 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:25.999406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:26.010064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:26.010527 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:26.011327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:26.011768 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:26.018298 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:26.019138 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:26.025751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:26.026446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:26.027409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:26.027997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:26.054298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:32:26.071443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:26.071893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:26.072344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lazy-loading 'fault' on Instance uuid daa24eb7-cd9f-4ca7-bad7-5c275879fecd {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:32:26.128747 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:26.136550 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:26.138032 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:26.139346 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5d9edc90-5530-4bf7-9c5a-7481b7400218 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 200 len: 1371 microversion: 2.20 time: 0.125132 May 10 20:32:26.140097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 343/711] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:26 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:32:26.169423 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-efb973d2-3de6-4502-9027-8a51ef81ff14 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 204 len: 0 microversion: 2.1 time: 0.174645 May 10 20:32:26.170018 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 369/712] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:32:25 2022] DELETE /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:32:26.179599 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:26.180221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:26.186556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:26.187002 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:26.187813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:26.188283 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:26.328823 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:26.336562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7cef6057-b2f3-4015-bf5d-1632dda3ae66 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1675 microversion: 2.1 time: 0.160915 May 10 20:32:26.337180 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 344/713] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:26 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:27.159401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:27.160090 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:27.166420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:27.166868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:27.167633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:27.168066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:27.182116 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] HTTP exception thrown: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Request method failure captured: May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd HTTP/1.1 May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesq0li_3yBP2XNiIv5pOqBP3CGe_cxdHkzIvwpAAihKWqTJknN-z_q4GuzNk06GF_uQ6HzOMRLklhy-J8XgPn_cSFvzxuE7ObcYb8MMNw3Dy79yxLcJ5cVZzZzBEx-a1nHisZJA07xFjNUtN78CS54BbWtS3p6T8UklMa3nm_EnvMoI May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:32:27.183802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_89cf2816f8884e679e6c7e4c3d98f348", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 36c95ddbd4384bb3a63d02698684e29a May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:32:27.185444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'daa24eb7-cd9f-4ca7-bad7-5c275879fecd'} May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:32:27.186257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:32:27.188000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:27.189800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Returning 404 to user: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:32:27.189800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-dbea888f-7d60-4e2b-9f25-28cf234c0d41 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 404 len: 111 microversion: 2.20 time: 0.030560 May 10 20:32:27.189800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 370/714] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:27 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:32:27.194215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-aed4582c-0e55-4a86-84f7-bef3c0355c3e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '.version_select at 0x7fb27822a5e0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:27.214882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-aed4582c-0e55-4a86-84f7-bef3c0355c3e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089650766" status: 204 len: 0 microversion: 2.20 time: 0.024450 May 10 20:32:27.215452 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 345/715] 10.222.0.61 () {60 vars in 1261 bytes} [Tue May 10 20:32:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1089650766 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 10 20:32:27.355276 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:27.355956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:27.367530 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:27.368198 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:27.369221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:27.369889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:27.630945 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:27.638355 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d81ba59e-c948-4ac1-ae27-41c5bc45d60c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1675 microversion: 2.1 time: 0.287345 May 10 20:32:27.638931 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 371/716] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:27 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1675 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:27.950879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1b08b799-d153-4598-85c4-14e11fb7b4cd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'create', calling method: .version_select at 0x7fb2781ee820>, body: {"keypair": {"name": "tempest-keypair-354853328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxd7qqBfgnzH78r/mBthZyF0ofCSz1irVt9u4+z2WzqE9pqIgKs/CfiGku55Y6t+2S7nHEoAR/zASuVtJPHwH0NXD7NfHcj+y/yQrPUeyhdV5qnzhLXC4bGucWImYVNUw=="}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:27.966961 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-1b08b799-d153-4598-85c4-14e11fb7b4cd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:32:27.975342 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-1b08b799-d153-4598-85c4-14e11fb7b4cd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for user 36c95ddbd4384bb3a63d02698684e29a and project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:32:27.998544 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1b08b799-d153-4598-85c4-14e11fb7b4cd tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051655 May 10 20:32:27.999156 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 346/717] 10.222.0.61 () {62 vars in 1199 bytes} [Tue May 10 20:32:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 20:32:28.657097 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:28.657642 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:28.665731 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:28.666188 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:28.666975 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:28.667410 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:28.807894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:28.815924 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ffd1f443-d5dc-4242-8c8d-d1921ba9c758 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1675 microversion: 2.1 time: 0.163680 May 10 20:32:28.817304 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 372/718] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:28 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:29.834940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:29.836232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:29.844582 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:29.849498 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:29.850736 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:29.851403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:29.854122 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-86baa78a-aa4c-42e9-b0b3-dbf47b18eac3 req-f07b4a65-1373-4feb-8a74-437eb1df1e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f69eab-9bdc-4e34-a3ed-e7417bc13c95", "name": "network-vif-deleted", "tag": "606fde48-a88c-4e4e-a204-c1d9ee0708f0"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:29.867361 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-86baa78a-aa4c-42e9-b0b3-dbf47b18eac3 req-f07b4a65-1373-4feb-8a74-437eb1df1e11 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:29.867816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-86baa78a-aa4c-42e9-b0b3-dbf47b18eac3 req-f07b4a65-1373-4feb-8a74-437eb1df1e11 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:29.912290 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-86baa78a-aa4c-42e9-b0b3-dbf47b18eac3 req-f07b4a65-1373-4feb-8a74-437eb1df1e11 service nova] Creating event network-vif-deleted:606fde48-a88c-4e4e-a204-c1d9ee0708f0 for instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 on hv-cinder-82880 May 10 20:32:29.918481 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-86baa78a-aa4c-42e9-b0b3-dbf47b18eac3 req-f07b4a65-1373-4feb-8a74-437eb1df1e11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067878 May 10 20:32:29.919272 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 373/719] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:32:29.933476 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:29.941934 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-da3e8c34-0ae2-4d92-ae90-35526547b737 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 200 len: 1607 microversion: 2.1 time: 0.111574 May 10 20:32:29.942513 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 347/720] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:29 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 1607 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:30.012358 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1497290109", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94296225-31bb-4ee2-9855-9dbaeebe459c"}], "security_groups": [{"name": "tempest-securitygroup--2060173171"}], "key_name": "tempest-keypair-354853328", "user_data": "}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:30.113679 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] validate_networks() for [('94296225-31bb-4ee2-9855-9dbaeebe459c', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:32:30.588811 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:32:30.589307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:32:30.589782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:32:30.590185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:32:30.590590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:32:30.599340 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:30.599788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:30.600619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:30.601083 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:30.619789 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:32:30.624443 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Getting quotas for user 36c95ddbd4384bb3a63d02698684e29a and project 89cf2816f8884e679e6c7e4c3d98f348. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:32:30.636072 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:32:30.638465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:32:30.683581 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6d480907-c118-4e4b-9026-ca166b1f11e1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.676779 May 10 20:32:30.684570 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 374/721] 10.222.0.61 () {62 vars in 1187 bytes} [Tue May 10 20:32:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 20:32:30.695659 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5f69f47a-ba86-4dfb-bf0c-01c7dfcbd7eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:30.696287 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5f69f47a-ba86-4dfb-bf0c-01c7dfcbd7eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:30.756849 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5f69f47a-ba86-4dfb-bf0c-01c7dfcbd7eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:30.764503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5f69f47a-ba86-4dfb-bf0c-01c7dfcbd7eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:30.766064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5f69f47a-ba86-4dfb-bf0c-01c7dfcbd7eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:30.767402 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5f69f47a-ba86-4dfb-bf0c-01c7dfcbd7eb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1281 microversion: 2.20 time: 0.076135 May 10 20:32:30.767962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 348/722] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:30 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:32:31.125472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:31.126096 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:31.132839 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:31.133264 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:31.134142 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:31.134585 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:31.148905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] HTTP exception thrown: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Request method failure captured: May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 HTTP/1.1 May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesqxi7V7XQA-k3rei_g2ZjFTN-zC7UGE1zcdZWO1gtdINDX1p0LiJWapE1vvPb-f2n8rWegW6AZxma-oWwvjrIkxtj2002-kMYxpRAoRlwXAQxONMg_TY-1dGCqukZtbWqe0ireN0hujGIn6Dy4NWJr3WUnyb0SOWZGodMqtXIGDHO4 May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:32:31.150646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/638a84064b2244e0b938b063e13cb944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_638a84064b2244e0b938b063e13cb944", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeTestJSON-1949992121 May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: e092796100394b63a7304abae7e25f7d May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:32:31.152120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '00f69eab-9bdc-4e34-a3ed-e7417bc13c95'} May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:32:31.153076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:32:31.154479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:32:31.155716 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Returning 404 to user: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:32:31.155716 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-671f7f12-4d34-4ac0-9b43-95e700f93f6f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 404 len: 111 microversion: 2.1 time: 0.197014 May 10 20:32:31.155716 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 375/723] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:30 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:32:31.161459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-385909ac-5053-4a9f-90c7-a1d208e9e35f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '.version_select at 0x7fb2781c3040>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:31.179955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-385909ac-5053-4a9f-90c7-a1d208e9e35f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608769025" status: 202 len: 0 microversion: 2.1 time: 0.022207 May 10 20:32:31.180527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 349/724] 10.222.0.61 () {58 vars in 1220 bytes} [Tue May 10 20:32:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1608769025 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:32:31.785909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:31.786871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:31.794074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:31.794531 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:31.795487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:31.796120 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:31.861768 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:31.871498 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:31.873526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:31.875506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bcd113ab-1392-4c07-840a-87436bb3c27f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1351 microversion: 2.20 time: 0.093279 May 10 20:32:31.876227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 376/725] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:31 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:31.888411 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-74e9edab-b728-48b0-a0b0-b5d2300d074a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'create', calling method: .version_select at 0x7fb2781c3dc0>, body: {"keypair": {"name": "tempest-keypair-1748594223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2MCshPlBTvkVCek3fm+y+Upw0lQd7Ie2QyiiCZomG32hiowh11TFvPTltWWzLow0UdaB2PpVyLq7/z11VCEpzrHCa7tiDU+2JeBYlT9Ep2QZvoHCTpY9SEEcPBVZrGuw=="}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:31.905423 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-74e9edab-b728-48b0-a0b0-b5d2300d074a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for project 638a84064b2244e0b938b063e13cb944. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:32:31.909191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-74e9edab-b728-48b0-a0b0-b5d2300d074a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for user e092796100394b63a7304abae7e25f7d and project 638a84064b2244e0b938b063e13cb944. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:32:31.932510 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-74e9edab-b728-48b0-a0b0-b5d2300d074a tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048651 May 10 20:32:31.933215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 350/726] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:32:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:32.896951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:32.898150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:32.909744 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:32.910351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:32.911260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:32.911815 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:33.118993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:33.127665 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:33.129491 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:33.130820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5adb6c6a-8a02-4177-a886-a6c35d08d71a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1407 microversion: 2.20 time: 0.240903 May 10 20:32:33.131852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 377/727] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:32 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:33.588094 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-156629572", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "836205da-476a-4894-bbf3-e76da5a6bb7f"}], "security_groups": [{"name": "tempest-securitygroup--1469439990"}], "key_name": "tempest-keypair-1748594223", "user_data": "}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:33.626792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-4d970a60-0699-4560-8d9e-62c15c144dc3 req-3714779c-b0e7-41eb-a0b5-ab925cbaafab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd776b6-60d4-4205-ac05-bfdb5b92c4b9", "tag": "f9a5ff83-f76c-42b5-8831-862bc9d49d17"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:33.638007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-4d970a60-0699-4560-8d9e-62c15c144dc3 req-3714779c-b0e7-41eb-a0b5-ab925cbaafab service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:33.638986 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-4d970a60-0699-4560-8d9e-62c15c144dc3 req-3714779c-b0e7-41eb-a0b5-ab925cbaafab service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:33.654882 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-4d970a60-0699-4560-8d9e-62c15c144dc3 req-3714779c-b0e7-41eb-a0b5-ab925cbaafab service nova] Creating event network-changed:f9a5ff83-f76c-42b5-8831-862bc9d49d17 for instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 on hv-cinder-82880 May 10 20:32:33.663521 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-4d970a60-0699-4560-8d9e-62c15c144dc3 req-3714779c-b0e7-41eb-a0b5-ab925cbaafab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040038 May 10 20:32:33.664632 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 378/728] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:33.718889 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] validate_networks() for [('836205da-476a-4894-bbf3-e76da5a6bb7f', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:32:34.096291 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:32:34.096711 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:32:34.097257 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:32:34.097674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:32:34.098086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:32:34.106732 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:34.107176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:34.107984 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:34.108422 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:34.125370 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for project 638a84064b2244e0b938b063e13cb944. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:32:34.129507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Getting quotas for user e092796100394b63a7304abae7e25f7d and project 638a84064b2244e0b938b063e13cb944. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:32:34.140278 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:32:34.143254 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:32:34.190674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-39805d03-b0dd-4711-ac02-fcc1ffccf556 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.609035 May 10 20:32:34.196402 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 351/729] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:32:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 20:32:34.200934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:34.201468 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a02406c7-fd91-4e58-a5d7-890f79f860a8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:34.201681 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:34.202202 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a02406c7-fd91-4e58-a5d7-890f79f860a8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:34.221971 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:34.222454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:34.225797 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:34.226248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:34.255252 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a02406c7-fd91-4e58-a5d7-890f79f860a8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:34.266792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a02406c7-fd91-4e58-a5d7-890f79f860a8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1237 microversion: 2.1 time: 0.069090 May 10 20:32:34.267954 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 352/730] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:34 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:34.364089 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:34.372135 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:34.373692 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:34.374859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-705159b7-c262-4187-a551-9d0f4044d0d2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1407 microversion: 2.20 time: 0.228995 May 10 20:32:34.375929 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 379/731] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:34 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1407 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:32:35.284331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:35.284947 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:35.291931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:35.292383 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:35.293241 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:35.293682 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:35.353195 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:35.360388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-064e5145-4c7c-421d-b658-81649530abe1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1289 microversion: 2.1 time: 0.080673 May 10 20:32:35.360956 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 353/732] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:35 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1289 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:35.393636 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:35.394242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:35.400792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:35.401264 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:35.402025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:35.402464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:35.537333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:35.545282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:35.546825 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:35.547946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3937a033-e52f-4081-829c-0d5048a86253 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1407 microversion: 2.20 time: 0.158760 May 10 20:32:35.548507 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 380/733] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:35 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:36.377792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:36.378406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:36.385527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:36.386069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:36.386938 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:36.387390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:36.525997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:36.540704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a385e377-6064-4dff-81b9-c48548a1439c tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.167029 May 10 20:32:36.541564 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 354/734] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:36 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:36.566967 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:36.568091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:36.575683 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:36.576138 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:36.577182 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:36.578354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:36.715966 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:36.724682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:36.726221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:36.727337 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-510b79d6-2e2e-41ab-a9ed-0a10f263666a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1407 microversion: 2.20 time: 0.165409 May 10 20:32:36.727897 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 381/735] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:36 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:37.046647 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-56d6d179-f407-40e8-b058-fb911515154f req-779c044c-f651-49b1-a4c7-8ebb762a85aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe946939-f5a9-4b1a-abf1-0753f505d60f", "tag": "f4759d7e-1e14-4fe1-9952-e0b7da16106f"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:37.056696 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-56d6d179-f407-40e8-b058-fb911515154f req-779c044c-f651-49b1-a4c7-8ebb762a85aa service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:37.057443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-56d6d179-f407-40e8-b058-fb911515154f req-779c044c-f651-49b1-a4c7-8ebb762a85aa service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:37.070832 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-56d6d179-f407-40e8-b058-fb911515154f req-779c044c-f651-49b1-a4c7-8ebb762a85aa service nova] Creating event network-changed:f4759d7e-1e14-4fe1-9952-e0b7da16106f for instance fe946939-f5a9-4b1a-abf1-0753f505d60f on hv-cinder-82880 May 10 20:32:37.075924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-56d6d179-f407-40e8-b058-fb911515154f req-779c044c-f651-49b1-a4c7-8ebb762a85aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032980 May 10 20:32:37.077005 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 355/736] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:32:37.558188 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:37.558720 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:37.565529 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:37.565987 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:37.566757 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:37.567200 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:37.695816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:37.703038 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a76f480f-5463-41ab-973e-3564efadc1ee tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.148730 May 10 20:32:37.703721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 382/737] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:37 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:37.745802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:37.746497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:37.752562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:37.753030 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:37.753787 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:37.754222 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:37.877361 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:37.884964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:37.886471 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:37.887559 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-75248073-1621-4d5d-81c4-36a7cf85edda tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1407 microversion: 2.20 time: 0.146420 May 10 20:32:37.888111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 356/738] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:37 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:38.719578 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:38.720245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:38.726905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:38.727376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:38.728151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:38.728590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:38.866315 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:38.878829 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4f2eedb2-662e-4b90-9fa5-b8630fdc2f15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.162946 May 10 20:32:38.880013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 383/739] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:38 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:32:38.890050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-8a42d02c-efe1-4b45-ba3d-006b50a69a58 req-e79812bc-0837-4df5-82e3-1cc537d681c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd776b6-60d4-4205-ac05-bfdb5b92c4b9", "name": "network-vif-plugged", "status": "completed", "tag": "f9a5ff83-f76c-42b5-8831-862bc9d49d17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:38.899424 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-8a42d02c-efe1-4b45-ba3d-006b50a69a58 req-e79812bc-0837-4df5-82e3-1cc537d681c4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:38.900060 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-8a42d02c-efe1-4b45-ba3d-006b50a69a58 req-e79812bc-0837-4df5-82e3-1cc537d681c4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:38.905580 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:38.906228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:38.920783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:38.921268 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:38.922607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:38.923046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:38.929186 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-8a42d02c-efe1-4b45-ba3d-006b50a69a58 req-e79812bc-0837-4df5-82e3-1cc537d681c4 service nova] Creating event network-vif-plugged:f9a5ff83-f76c-42b5-8831-862bc9d49d17 for instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 on hv-cinder-82880 May 10 20:32:38.934460 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-8a42d02c-efe1-4b45-ba3d-006b50a69a58 req-e79812bc-0837-4df5-82e3-1cc537d681c4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047929 May 10 20:32:38.935304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 357/740] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:32:39.068509 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:39.076472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:39.078033 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:39.079141 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e1a2d7a4-fb16-4eca-b60b-70ce81a098c4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1407 microversion: 2.20 time: 0.177565 May 10 20:32:39.079703 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 384/741] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:38 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:32:39.897655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:39.898273 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:39.904826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:39.905317 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:39.906716 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:39.907160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:40.040016 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:40.047324 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-590b42ec-f455-4216-9553-bf92c3684e70 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.154354 May 10 20:32:40.047888 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 358/742] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:39 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:40.096191 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:40.096833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:40.103186 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:40.103638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:40.104408 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:40.104848 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:40.232854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:40.240638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:40.242185 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:40.243295 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b0b464c3-17c5-4ff3-846e-5e6c31667483 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1407 microversion: 2.20 time: 0.151004 May 10 20:32:40.243861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 385/743] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:40 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:41.063708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:41.064366 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:41.070793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:41.071238 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:41.072010 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:41.072448 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:41.199512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:41.207200 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3e7b19cc-0dc3-48e8-90f6-3eb83274e1a2 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.147530 May 10 20:32:41.207766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 359/744] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:41 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:41.261363 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:41.261883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:41.268652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:41.269121 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:41.270133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:41.270566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:41.400624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:41.409068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:41.410565 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:41.411727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5733c378-fcce-4c3b-bd26-d74b294ddcd8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1599 microversion: 2.20 time: 0.154345 May 10 20:32:41.412281 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 386/745] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:32:41 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:32:41.428897 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5b0da68b-acaf-44a4-a49e-2fab9b7db570 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:41.429646 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5b0da68b-acaf-44a4-a49e-2fab9b7db570 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:41.435413 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b0da68b-acaf-44a4-a49e-2fab9b7db570 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:41.435929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b0da68b-acaf-44a4-a49e-2fab9b7db570 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:41.436756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b0da68b-acaf-44a4-a49e-2fab9b7db570 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:41.437827 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b0da68b-acaf-44a4-a49e-2fab9b7db570 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:41.512930 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5b0da68b-acaf-44a4-a49e-2fab9b7db570 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087812 May 10 20:32:41.513588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 360/746] 10.222.0.61 () {60 vars in 1315 bytes} [Tue May 10 20:32:41 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:32:42.223834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:42.224484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:42.230384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:42.230841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:42.231619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:42.232065 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:42.430411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:42.438393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9f2ba728-3205-4680-bcf2-59ec7de49cfa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.218310 May 10 20:32:42.438994 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 387/747] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:42 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:42.528426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-56438fe2-64af-43c3-a5db-f340bae5fddf req-88cb7722-f080-4821-8a26-9db17947e886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efd776b6-60d4-4205-ac05-bfdb5b92c4b9", "tag": "f9a5ff83-f76c-42b5-8831-862bc9d49d17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:42.537907 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-56438fe2-64af-43c3-a5db-f340bae5fddf req-88cb7722-f080-4821-8a26-9db17947e886 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:42.538347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-56438fe2-64af-43c3-a5db-f340bae5fddf req-88cb7722-f080-4821-8a26-9db17947e886 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:42.549848 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-56438fe2-64af-43c3-a5db-f340bae5fddf req-88cb7722-f080-4821-8a26-9db17947e886 service nova] Creating event network-changed:f9a5ff83-f76c-42b5-8831-862bc9d49d17 for instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 on hv-cinder-82880 May 10 20:32:42.554718 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-56438fe2-64af-43c3-a5db-f340bae5fddf req-88cb7722-f080-4821-8a26-9db17947e886 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030370 May 10 20:32:42.555414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 361/748] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:43.088707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-b8439e6c-dd74-478b-9b5c-f0597ea728c2 req-c5dbdc4f-8d13-42d2-9fd3-547d803abc2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe946939-f5a9-4b1a-abf1-0753f505d60f", "name": "network-vif-plugged", "status": "completed", "tag": "f4759d7e-1e14-4fe1-9952-e0b7da16106f"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:43.098853 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-b8439e6c-dd74-478b-9b5c-f0597ea728c2 req-c5dbdc4f-8d13-42d2-9fd3-547d803abc2e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:43.099323 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-b8439e6c-dd74-478b-9b5c-f0597ea728c2 req-c5dbdc4f-8d13-42d2-9fd3-547d803abc2e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:43.113259 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-b8439e6c-dd74-478b-9b5c-f0597ea728c2 req-c5dbdc4f-8d13-42d2-9fd3-547d803abc2e service nova] Creating event network-vif-plugged:f4759d7e-1e14-4fe1-9952-e0b7da16106f for instance fe946939-f5a9-4b1a-abf1-0753f505d60f on hv-cinder-82880 May 10 20:32:43.118230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-b8439e6c-dd74-478b-9b5c-f0597ea728c2 req-c5dbdc4f-8d13-42d2-9fd3-547d803abc2e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034352 May 10 20:32:43.118770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 388/749] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:43.456316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:43.457057 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:43.463570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:43.464032 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:43.464819 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:43.465291 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:43.606581 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:43.614267 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ccf9005f-7aa3-470e-ba14-a94a26fcd74b tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.162677 May 10 20:32:43.614843 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 362/750] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:43 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:44.632080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:44.632778 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:44.639003 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:44.639457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:44.640234 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:44.640676 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:44.766428 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:44.774016 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5a2159e7-3d74-417b-9ee2-8aa56e76fdb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1363 microversion: 2.1 time: 0.146564 May 10 20:32:44.774584 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 389/751] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:44 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:45.790500 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:45.791123 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:45.797908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:45.798351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:45.799116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:45.799548 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:45.927219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:45.934438 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-52c844d4-4953-49ef-abf0-fa5a4b76ac12 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1550 microversion: 2.1 time: 0.147794 May 10 20:32:45.935000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 363/752] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:45 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1550 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:45.950458 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-cef25228-d3c1-4f75-a273-39bdc674caa1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:45.950951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-cef25228-d3c1-4f75-a273-39bdc674caa1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:45.957225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cef25228-d3c1-4f75-a273-39bdc674caa1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:45.957672 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cef25228-d3c1-4f75-a273-39bdc674caa1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:45.958429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cef25228-d3c1-4f75-a273-39bdc674caa1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:45.958863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-cef25228-d3c1-4f75-a273-39bdc674caa1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:46.036064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-cef25228-d3c1-4f75-a273-39bdc674caa1 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089317 May 10 20:32:46.036754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 390/753] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:32:45 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:47.223494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-009111f7-f9dc-4fcc-80f1-5520986a5fbd req-a74d3813-76cf-4ae1-967a-6af6c44e342a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe946939-f5a9-4b1a-abf1-0753f505d60f", "tag": "f4759d7e-1e14-4fe1-9952-e0b7da16106f"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:47.231797 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-009111f7-f9dc-4fcc-80f1-5520986a5fbd req-a74d3813-76cf-4ae1-967a-6af6c44e342a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:47.232318 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-009111f7-f9dc-4fcc-80f1-5520986a5fbd req-a74d3813-76cf-4ae1-967a-6af6c44e342a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:47.243446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-009111f7-f9dc-4fcc-80f1-5520986a5fbd req-a74d3813-76cf-4ae1-967a-6af6c44e342a service nova] Creating event network-changed:f4759d7e-1e14-4fe1-9952-e0b7da16106f for instance fe946939-f5a9-4b1a-abf1-0753f505d60f on hv-cinder-82880 May 10 20:32:47.248367 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-009111f7-f9dc-4fcc-80f1-5520986a5fbd req-a74d3813-76cf-4ae1-967a-6af6c44e342a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028462 May 10 20:32:47.249072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 364/754] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:53.622277 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:53.622785 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:53.628735 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:53.629227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:53.629994 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:53.630437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:53.707827 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lazy-loading 'services' on Instance uuid 47fb1639-3b60-43d2-8dfe-60110e829a8d {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:32:53.776188 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ba86315a-bae4-4658-9e0c-5f0b70319c2d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments/ef02b74c-53ba-4416-8353-7a5345a99dc0" status: 202 len: 0 microversion: 2.1 time: 0.158667 May 10 20:32:53.776772 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 391/755] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:32:53 2022] DELETE /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments/ef02b74c-53ba-4416-8353-7a5345a99dc0 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:32:53.787318 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-051a21c2-58b0-436c-b9e5-de8260c4f51d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:53.788429 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-051a21c2-58b0-436c-b9e5-de8260c4f51d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:53.794862 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-051a21c2-58b0-436c-b9e5-de8260c4f51d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:53.795419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-051a21c2-58b0-436c-b9e5-de8260c4f51d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:53.796392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-051a21c2-58b0-436c-b9e5-de8260c4f51d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:53.796830 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-051a21c2-58b0-436c-b9e5-de8260c4f51d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:53.827212 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-051a21c2-58b0-436c-b9e5-de8260c4f51d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045886 May 10 20:32:53.827763 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 365/756] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:32:53 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:32:54.840449 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ac017bf7-43c7-4616-b7c7-5db48224be67 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:54.841480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ac017bf7-43c7-4616-b7c7-5db48224be67 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:54.847810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac017bf7-43c7-4616-b7c7-5db48224be67 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:54.848264 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac017bf7-43c7-4616-b7c7-5db48224be67 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:54.849071 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac017bf7-43c7-4616-b7c7-5db48224be67 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:54.849510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ac017bf7-43c7-4616-b7c7-5db48224be67 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:54.877788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ac017bf7-43c7-4616-b7c7-5db48224be67 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042191 May 10 20:32:54.878337 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 392/757] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:32:54 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:32:54.948478 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:54.949065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:54.955275 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:54.955736 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:54.956512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:54.956960 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:54.981886 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:32:55.055297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ea74f9c8-b0d9-459b-90b0-f7a47219ac70 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "DELETE /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 204 len: 0 microversion: 2.1 time: 0.110344 May 10 20:32:55.055998 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 366/758] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:32:54 2022] DELETE /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:32:55.064921 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:55.065694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:55.071720 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:55.072157 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:55.072924 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:55.073457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:55.199210 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:55.206694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fdf2f6c8-090d-4502-8129-51eb8dd7e7a0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1689 microversion: 2.1 time: 0.146321 May 10 20:32:55.207261 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 393/759] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:55 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:56.224557 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:56.225282 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:56.231600 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:56.232049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:56.232819 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:56.233292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:56.362722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:56.370025 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c5887579-f3be-473f-b339-77b6525eb699 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1689 microversion: 2.1 time: 0.149693 May 10 20:32:56.370598 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 367/760] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:56 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:57.387354 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:57.387974 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:57.394744 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:57.395196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:57.396095 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:57.396540 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:57.522491 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:57.529906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0cca55ac-2fd2-4e00-b0ce-38ca1119c2d0 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1689 microversion: 2.1 time: 0.146487 May 10 20:32:57.530481 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 394/761] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:57 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:58.548505 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:58.549143 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:58.555553 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:58.555993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:58.556946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:58.557409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:58.687419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:58.695148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-02fdad53-fca1-4d73-bbc0-bf185b65c6e6 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1689 microversion: 2.1 time: 0.150995 May 10 20:32:58.695730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 368/762] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:58 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:32:59.281611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1083560296"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:59.282146 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:59.288659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.289151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.289932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.290369 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.417967 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.network.security_group_api [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Removing security group 86e866fd-4b07-4350-b5c6-a58b9b5f56a8 from port 17b60462-c5b3-4701-9d7d-de886673ef7d May 10 20:32:59.712247 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:32:59.714199 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:32:59.720872 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.721600 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.722629 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.723581 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.821837 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:32:59.826484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-306d88b2-44e7-4242-9bcd-e7d365e17186 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/action" status: 202 len: 0 microversion: 2.1 time: 0.549450 May 10 20:32:59.827215 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 395/763] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:32:59 2022] POST /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:32:59.832069 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4a891c19-eb29-4dfd-a02b-28f801502385 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 200 len: 1621 microversion: 2.1 time: 0.123957 May 10 20:32:59.833025 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 369/764] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:32:59 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 1621 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:32:59.940353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-6bc54abb-efa0-4f2c-9d07-f6a0469c199e req-19e2d56c-60a0-42f2-8645-992df9ab9452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6131f4a-2a40-4b33-bf35-763bb6dbf01c", "tag": "17b60462-c5b3-4701-9d7d-de886673ef7d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:32:59.951437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-6bc54abb-efa0-4f2c-9d07-f6a0469c199e req-19e2d56c-60a0-42f2-8645-992df9ab9452 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:32:59.952143 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-6bc54abb-efa0-4f2c-9d07-f6a0469c199e req-19e2d56c-60a0-42f2-8645-992df9ab9452 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:32:59.974621 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-6bc54abb-efa0-4f2c-9d07-f6a0469c199e req-19e2d56c-60a0-42f2-8645-992df9ab9452 service nova] Creating event network-changed:17b60462-c5b3-4701-9d7d-de886673ef7d for instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c on hv-cinder-82880 May 10 20:32:59.985098 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-6bc54abb-efa0-4f2c-9d07-f6a0469c199e req-19e2d56c-60a0-42f2-8645-992df9ab9452 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145735 May 10 20:32:59.985664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 396/765] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:00.243392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-2b8c872b-ad2f-46ea-9bf6-80a4a4041a64 req-46fd8b37-722c-422f-bb7c-37c5b2f1629a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47fb1639-3b60-43d2-8dfe-60110e829a8d", "name": "network-vif-deleted", "tag": "47de41f7-9f27-4859-b152-66f1ab4268f4"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:00.259601 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-2b8c872b-ad2f-46ea-9bf6-80a4a4041a64 req-46fd8b37-722c-422f-bb7c-37c5b2f1629a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:00.274556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-2b8c872b-ad2f-46ea-9bf6-80a4a4041a64 req-46fd8b37-722c-422f-bb7c-37c5b2f1629a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:00.302932 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-2b8c872b-ad2f-46ea-9bf6-80a4a4041a64 req-46fd8b37-722c-422f-bb7c-37c5b2f1629a service nova] Creating event network-vif-deleted:47de41f7-9f27-4859-b152-66f1ab4268f4 for instance 47fb1639-3b60-43d2-8dfe-60110e829a8d on hv-cinder-82880 May 10 20:33:00.320384 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-2b8c872b-ad2f-46ea-9bf6-80a4a4041a64 req-46fd8b37-722c-422f-bb7c-37c5b2f1629a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228378 May 10 20:33:00.321649 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 370/766] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:00.850255 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:00.851638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 47fb1639-3b60-43d2-8dfe-60110e829a8d] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:00.858659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:00.859493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:00.860522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:00.861219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:00.877623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] HTTP exception thrown: Instance 47fb1639-3b60-43d2-8dfe-60110e829a8d could not be found. May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Request method failure captured: May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d HTTP/1.1 May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesq0Vc_JFx25RDdGrab6G1Iqu_JtPPyOBfXB8fkoV9jcyK650upwuLU5hG6oDEdqSuuvbiquU2zsKAUQg3ZRDYCridJB_yYopyk0JTkLq68JtvfMdR6Gly2BpmcpOsEo14_p6IHGfWiEfacS-oEsbkwH3bvVn6fY4ezHZcjBsuf-y7g May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:00.879623 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67dae2f388bc4a81bc957f48b1b02e42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: df3cf8a2f7c54b80aac61d6ca59672b5 May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 47fb1639-3b60-43d2-8dfe-60110e829a8d could not be found. May 10 20:33:00.881007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '47fb1639-3b60-43d2-8dfe-60110e829a8d'} May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47fb1639-3b60-43d2-8dfe-60110e829a8d could not be found. May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:00.881771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47fb1639-3b60-43d2-8dfe-60110e829a8d could not be found. May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47fb1639-3b60-43d2-8dfe-60110e829a8d could not be found. May 10 20:33:00.882989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:00.885649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Returning 404 to user: Instance 47fb1639-3b60-43d2-8dfe-60110e829a8d could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:00.886863 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4d11bed7-ea63-4692-95e5-1d3ce6e54255 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d" status: 404 len: 111 microversion: 2.1 time: 0.040859 May 10 20:33:00.897446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7856a147-825e-4da8-bb02-d1f0cf8e743a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '.version_select at 0x7fb2781c30d0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:00.901624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 397/767] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:00 2022] GET /compute/v2.1/servers/47fb1639-3b60-43d2-8dfe-60110e829a8d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:00.919233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7856a147-825e-4da8-bb02-d1f0cf8e743a tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620750835" status: 202 len: 0 microversion: 2.1 time: 0.026326 May 10 20:33:00.920211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 371/768] 10.222.0.61 () {58 vars in 1220 bytes} [Tue May 10 20:33:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1620750835 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:33:01.264229 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:01.264733 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:01.274273 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:01.275674 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:01.276665 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:01.277567 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:01.376126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lazy-loading 'services' on Instance uuid b6131f4a-2a40-4b33-bf35-763bb6dbf01c {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:01.454488 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a8d61d4b-0e58-4db0-b481-65e7a5d371fc tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments/3af27f3d-fe6d-4785-b52a-79d5320f0770" status: 202 len: 0 microversion: 2.1 time: 0.195483 May 10 20:33:01.456051 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 398/769] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:33:01 2022] DELETE /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments/3af27f3d-fe6d-4785-b52a-79d5320f0770 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:33:01.470033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d19c5885-bc92-4554-918e-57f94cdffa45 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:01.471091 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d19c5885-bc92-4554-918e-57f94cdffa45 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:01.479032 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d19c5885-bc92-4554-918e-57f94cdffa45 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:01.479494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d19c5885-bc92-4554-918e-57f94cdffa45 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:01.480288 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d19c5885-bc92-4554-918e-57f94cdffa45 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:01.488281 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d19c5885-bc92-4554-918e-57f94cdffa45 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:01.532958 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d19c5885-bc92-4554-918e-57f94cdffa45 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072137 May 10 20:33:01.534033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 372/770] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:33:01 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:02.005615 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-7138ab52-fd5b-4dcd-951c-d8104c607444 req-43d01fad-7a82-4f07-867e-98d41bfbb915 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6131f4a-2a40-4b33-bf35-763bb6dbf01c", "tag": "17b60462-c5b3-4701-9d7d-de886673ef7d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:02.014588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-7138ab52-fd5b-4dcd-951c-d8104c607444 req-43d01fad-7a82-4f07-867e-98d41bfbb915 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:02.015031 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-7138ab52-fd5b-4dcd-951c-d8104c607444 req-43d01fad-7a82-4f07-867e-98d41bfbb915 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:02.027574 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-7138ab52-fd5b-4dcd-951c-d8104c607444 req-43d01fad-7a82-4f07-867e-98d41bfbb915 service nova] Creating event network-changed:17b60462-c5b3-4701-9d7d-de886673ef7d for instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c on hv-cinder-82880 May 10 20:33:02.033266 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-7138ab52-fd5b-4dcd-951c-d8104c607444 req-43d01fad-7a82-4f07-867e-98d41bfbb915 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032347 May 10 20:33:02.033871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 399/771] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:02.544724 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d7f2d5a1-db39-4224-8511-7e0a7fbd1125 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:02.545592 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d7f2d5a1-db39-4224-8511-7e0a7fbd1125 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:02.551827 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d7f2d5a1-db39-4224-8511-7e0a7fbd1125 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:02.552282 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d7f2d5a1-db39-4224-8511-7e0a7fbd1125 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:02.553089 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d7f2d5a1-db39-4224-8511-7e0a7fbd1125 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:02.553531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d7f2d5a1-db39-4224-8511-7e0a7fbd1125 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:02.582064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d7f2d5a1-db39-4224-8511-7e0a7fbd1125 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041262 May 10 20:33:02.583310 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 373/772] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:33:02 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:33:02.593749 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:02.594436 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:02.601159 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:02.601700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:02.602486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:02.602926 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:02.674831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] HTTP exception thrown: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c is not attached to volume 3af27f3d-fe6d-4785-b52a-79d5320f0770 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Request method failure captured: May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: DELETE /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments/3af27f3d-fe6d-4785-b52a-79d5320f0770 HTTP/1.1 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiessnwkjwxp4nTdY9ShWyJp3iEYk2B554nsSu1Y1vHKSRs9fB4W5x2Hz7LfpuMDI27UwgeAl6kY9mwZnsDn2ISYTF65OFJi4f-hUos4VL1TMCHaIF3bRTf93ohiJ6cVlSArT3I47FmV6nAQ40RO-UCDATpCifsBugEJS7291SVYskpU0 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 51884a66cf014d6596d22c37c4a97147 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-TestMinimumBasicScenario-819777149 May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:02.686401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51884a66cf014d6596d22c37c4a97147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/51884a66cf014d6596d22c37c4a97147"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_51884a66cf014d6596d22c37c4a97147", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51884a66cf014d6596d22c37c4a97147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-TestMinimumBasicScenario-819777149 May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 51884a66cf014d6596d22c37c4a97147 May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-TestMinimumBasicScenario-819777149 May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-TestMinimumBasicScenario-819777149-project May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 50d5a87e4d094287bb543721c9c9909d May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-TestMinimumBasicScenario-819777149-project May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:33:02.688451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c is not attached to volume 3af27f3d-fe6d-4785-b52a-79d5320f0770 May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'server_id': 'b6131f4a-2a40-4b33-bf35-763bb6dbf01c', 'id': '3af27f3d-fe6d-4785-b52a-79d5320f0770'} May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3af27f3d-fe6d-4785-b52a-79d5320f0770. May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:02.689286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c is not attached to volume 3af27f3d-fe6d-4785-b52a-79d5320f0770 May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c is not attached to volume 3af27f3d-fe6d-4785-b52a-79d5320f0770 May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:02.690614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Returning 404 to user: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c is not attached to volume 3af27f3d-fe6d-4785-b52a-79d5320f0770 {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:02.691680 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a50010b4-6b87-43c7-89c7-3571ba98140d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments/3af27f3d-fe6d-4785-b52a-79d5320f0770" status: 404 len: 154 microversion: 2.1 time: 0.098991 May 10 20:33:02.691680 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 400/773] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:33:02 2022] DELETE /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c/os-volume_attachments/3af27f3d-fe6d-4785-b52a-79d5320f0770 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:33:03.823675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:03.824195 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:03.830417 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:03.830863 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:03.831619 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:03.832052 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:03.855370 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:33:03.926831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-359a152f-635f-4d47-8c2e-33f264c9eaf5 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 204 len: 0 microversion: 2.1 time: 0.106632 May 10 20:33:03.927430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 374/774] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:33:03 2022] DELETE /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:33:03.935650 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:03.936260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:03.942566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:03.943011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:03.943770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:03.944204 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:04.028570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:04.029303 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:04.035799 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:04.036356 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:04.037286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:04.037792 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:04.062864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:33:04.074970 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:04.082353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d3c1f156-1c5f-446c-8014-15add5afb188 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1552 microversion: 2.1 time: 0.150532 May 10 20:33:04.083048 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 401/775] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:03 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:04.135208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c193e9d0-fefc-4529-860a-a65c8724a817 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 204 len: 0 microversion: 2.1 time: 0.110881 May 10 20:33:04.135773 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 375/776] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:33:04 2022] DELETE /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:33:04.143626 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:04.144569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:04.150625 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:04.151096 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:04.151873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:04.152342 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:04.277346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:04.285238 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2534cc03-843e-45db-a8ea-0b44f0604e83 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1508 microversion: 2.1 time: 0.145441 May 10 20:33:04.285803 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 402/777] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:04 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:05.099410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:05.100114 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:05.106461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:05.106919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:05.107695 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:05.108136 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:05.236851 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:05.244165 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1793cd37-e8bb-40fa-ad65-8d4f41ee9db3 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1552 microversion: 2.1 time: 0.149006 May 10 20:33:05.244734 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 376/778] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:05 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:05.303309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:05.303918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:05.310252 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:05.310698 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:05.311457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:05.311889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:05.437217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:05.444511 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b9ca1404-add6-43c5-b8e0-cdb766728ec2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1508 microversion: 2.1 time: 0.145112 May 10 20:33:05.445113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 403/779] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:05 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:06.261739 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:06.262258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:06.269371 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:06.269825 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:06.270585 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:06.271017 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:06.396489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:06.403722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0e8607ba-5a24-4501-a032-ab81e2f4447a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1552 microversion: 2.1 time: 0.145890 May 10 20:33:06.404285 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 377/780] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:06 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:06.460263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:06.460880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:06.467232 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:06.467692 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:06.468473 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:06.468916 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:06.592920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:06.600284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-305983f1-895b-436f-847c-046e72f4b526 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1508 microversion: 2.1 time: 0.143833 May 10 20:33:06.600861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 404/781] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:06 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:07.420491 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:07.421156 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:07.428138 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:07.428684 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:07.429483 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:07.429919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:07.555031 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:07.562957 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b402678d-8dfb-45a7-ac05-b8013394f35d tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1552 microversion: 2.1 time: 0.145797 May 10 20:33:07.563528 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 378/782] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:07 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1552 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:07.617144 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:07.617747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:07.623997 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:07.624515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:07.625864 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:07.626298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:07.756648 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:07.764031 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b7416148-3090-4117-9404-c5b9cca69e9f tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1508 microversion: 2.1 time: 0.150687 May 10 20:33:07.764602 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 405/783] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:07 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:08.580155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:08.580770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:08.586984 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:08.587425 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:08.588189 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:08.588621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:08.715805 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50d5a87e4d094287bb543721c9c9909d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51884a66cf014d6596d22c37c4a97147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:08.723704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3d7fb7ea-d909-423e-aa1a-61db82b7502a tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 200 len: 1552 microversion: 2.1 time: 0.147927 May 10 20:33:08.724328 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 379/784] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:08 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:08.780628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:08.781207 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:08.787489 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:08.787929 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:08.788706 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:08.789165 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:08.926826 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:08.934248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d50f8a6b-e146-4e0c-acd3-8368b293e1d2 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 200 len: 1508 microversion: 2.1 time: 0.157667 May 10 20:33:08.934824 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 406/785] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:08 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:08.956063 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-ac37a216-9165-444e-bb55-e51480a4c067 req-03616b26-cdb3-4d9d-8cfc-6a939677963c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6131f4a-2a40-4b33-bf35-763bb6dbf01c", "name": "network-vif-deleted", "tag": "17b60462-c5b3-4701-9d7d-de886673ef7d"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:08.964907 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ac37a216-9165-444e-bb55-e51480a4c067 req-03616b26-cdb3-4d9d-8cfc-6a939677963c service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:08.965441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ac37a216-9165-444e-bb55-e51480a4c067 req-03616b26-cdb3-4d9d-8cfc-6a939677963c service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:08.979748 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-ac37a216-9165-444e-bb55-e51480a4c067 req-03616b26-cdb3-4d9d-8cfc-6a939677963c service nova] Creating event network-vif-deleted:17b60462-c5b3-4701-9d7d-de886673ef7d for instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c on hv-cinder-82880 May 10 20:33:08.985440 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-ac37a216-9165-444e-bb55-e51480a4c067 req-03616b26-cdb3-4d9d-8cfc-6a939677963c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033848 May 10 20:33:08.987137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 380/786] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:33:09.741286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:09.741920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] [instance: b6131f4a-2a40-4b33-bf35-763bb6dbf01c] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:09.747923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.748406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.749198 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.750378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.763544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] HTTP exception thrown: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c could not be found. May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Request method failure captured: May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c HTTP/1.1 May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiessnwkjwxp4nTdY9ShWyJp3iEYk2B554nsSu1Y1vHKSRs9fB4W5x2Hz7LfpuMDI27UwgeAl6kY9mwZnsDn2ISYTF65OFJi4f-hUos4VL1TMCHaIF3bRTf93ohiJ6cVlSArT3I47FmV6nAQ40RO-UCDATpCifsBugEJS7291SVYskpU0 May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 51884a66cf014d6596d22c37c4a97147 May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-TestMinimumBasicScenario-819777149 May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:09.765183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51884a66cf014d6596d22c37c4a97147"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/51884a66cf014d6596d22c37c4a97147"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_51884a66cf014d6596d22c37c4a97147", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/51884a66cf014d6596d22c37c4a97147"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-TestMinimumBasicScenario-819777149 May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 51884a66cf014d6596d22c37c4a97147 May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-TestMinimumBasicScenario-819777149 May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-TestMinimumBasicScenario-819777149-project May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 50d5a87e4d094287bb543721c9c9909d May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-TestMinimumBasicScenario-819777149-project May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c could not be found. May 10 20:33:09.766783 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'b6131f4a-2a40-4b33-bf35-763bb6dbf01c'} May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c could not be found. May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:09.767685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c could not be found. May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c could not be found. May 10 20:33:09.769472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.770787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Returning 404 to user: Instance b6131f4a-2a40-4b33-bf35-763bb6dbf01c could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:09.770787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-097bbd5b-d941-4993-9be9-687cb613ea28 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c" status: 404 len: 111 microversion: 2.1 time: 0.029437 May 10 20:33:09.770787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 407/787] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:09 2022] GET /compute/v2.1/servers/b6131f4a-2a40-4b33-bf35-763bb6dbf01c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:09.780414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-02a364d6-6f68-45af-a654-d0093d701be7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] Calling method '.version_select at 0x7fb2784d8160>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:09.798772 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-02a364d6-6f68-45af-a654-d0093d701be7 tempest-TestMinimumBasicScenario-819777149 tempest-TestMinimumBasicScenario-819777149-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-84461549" status: 202 len: 0 microversion: 2.1 time: 0.023059 May 10 20:33:09.799348 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 381/788] 10.222.0.61 () {58 vars in 1265 bytes} [Tue May 10 20:33:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-84461549 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:33:09.951667 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:09.952413 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: 7863f3c8-d62c-4cc1-be62-0902625d59fe] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:09.958969 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.959569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.960418 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.960930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.974969 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] HTTP exception thrown: Instance 7863f3c8-d62c-4cc1-be62-0902625d59fe could not be found. May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Request method failure captured: May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe HTTP/1.1 May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesq0Vc_JFx25RDdGrab6G1Iqu_JtPPyOBfXB8fkoV9jcyK650upwuLU5hG6oDEdqSuuvbiquU2zsKAUQg3ZRDYCridJB_yYopyk0JTkLq68JtvfMdR6Gly2BpmcpOsEo14_p6IHGfWiEfacS-oEsbkwH3bvVn6fY4ezHZcjBsuf-y7g May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:09.976617 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67dae2f388bc4a81bc957f48b1b02e42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: df3cf8a2f7c54b80aac61d6ca59672b5 May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 7863f3c8-d62c-4cc1-be62-0902625d59fe could not be found. May 10 20:33:09.978301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '7863f3c8-d62c-4cc1-be62-0902625d59fe'} May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7863f3c8-d62c-4cc1-be62-0902625d59fe could not be found. May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:09.979158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7863f3c8-d62c-4cc1-be62-0902625d59fe could not be found. May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7863f3c8-d62c-4cc1-be62-0902625d59fe could not be found. May 10 20:33:09.980348 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:09.981992 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Returning 404 to user: Instance 7863f3c8-d62c-4cc1-be62-0902625d59fe could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:09.981992 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0ece1981-57e3-464e-882d-3e3e71fc48e3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe" status: 404 len: 111 microversion: 2.1 time: 0.030981 May 10 20:33:09.981992 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 408/789] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:09 2022] GET /compute/v2.1/servers/7863f3c8-d62c-4cc1-be62-0902625d59fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:09.987787 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:09.988493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:09.994561 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.995105 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:09.995943 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:09.996456 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:10.020826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:33:10.105532 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d39fec86-fa82-4803-a060-7745520fccd3 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 204 len: 0 microversion: 2.1 time: 0.121659 May 10 20:33:10.106164 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 382/790] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:33:09 2022] DELETE /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:33:10.114721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:10.115566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:10.122710 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:10.123258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:10.124130 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:10.124620 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:10.262352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:10.270398 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ae721cf2-8ca2-4bb3-bda8-04bcace7f80d tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.159582 May 10 20:33:10.270958 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 409/791] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:10 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:11.156636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-92d2f662-4f52-41c2-bb1a-64516f30f32f req-4ea0f4db-6427-48bd-9472-a898bcbc7079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7863f3c8-d62c-4cc1-be62-0902625d59fe", "name": "network-vif-deleted", "tag": "d8189a32-1a03-4f88-9ea0-92488138491a"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:11.164880 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-92d2f662-4f52-41c2-bb1a-64516f30f32f req-4ea0f4db-6427-48bd-9472-a898bcbc7079 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:11.165357 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-92d2f662-4f52-41c2-bb1a-64516f30f32f req-4ea0f4db-6427-48bd-9472-a898bcbc7079 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:11.176388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-92d2f662-4f52-41c2-bb1a-64516f30f32f req-4ea0f4db-6427-48bd-9472-a898bcbc7079 service nova] Creating event network-vif-deleted:d8189a32-1a03-4f88-9ea0-92488138491a for instance 7863f3c8-d62c-4cc1-be62-0902625d59fe on hv-cinder-82880 May 10 20:33:11.181190 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-92d2f662-4f52-41c2-bb1a-64516f30f32f req-4ea0f4db-6427-48bd-9472-a898bcbc7079 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028779 May 10 20:33:11.181770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 383/792] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:11.289205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:11.289834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:11.296857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:11.297341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:11.298150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:11.299190 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:11.425068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:11.432487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f352c246-de69-4085-a8d1-e37bafb12a41 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.147269 May 10 20:33:11.433079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 410/793] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:11 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:12.450963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:12.451692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:12.457723 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:12.458183 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:12.458958 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:12.459381 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:12.594677 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:12.602988 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1eb45c31-a72d-45f9-8863-806e3476a3dc tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1523 microversion: 2.1 time: 0.156814 May 10 20:33:12.603675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 384/794] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:12 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:13.428600 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-863d8e16-2696-4ab4-a646-4f5d716f10b8 req-654f3a46-618c-4fca-b7e7-1cd2f6a941dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffd77532-d88b-4fc0-8ffd-81bc169e55db", "name": "network-vif-deleted", "tag": "06c622a7-be22-49f6-bfdf-2e75a819556e"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:13.446965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-863d8e16-2696-4ab4-a646-4f5d716f10b8 req-654f3a46-618c-4fca-b7e7-1cd2f6a941dd service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:13.447503 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-863d8e16-2696-4ab4-a646-4f5d716f10b8 req-654f3a46-618c-4fca-b7e7-1cd2f6a941dd service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:13.460286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-863d8e16-2696-4ab4-a646-4f5d716f10b8 req-654f3a46-618c-4fca-b7e7-1cd2f6a941dd service nova] Creating event network-vif-deleted:06c622a7-be22-49f6-bfdf-2e75a819556e for instance ffd77532-d88b-4fc0-8ffd-81bc169e55db on hv-cinder-82880 May 10 20:33:13.466479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-863d8e16-2696-4ab4-a646-4f5d716f10b8 req-654f3a46-618c-4fca-b7e7-1cd2f6a941dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041648 May 10 20:33:13.469862 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 411/795] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:13.621086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:13.622548 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:13.633053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:13.633847 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:13.634880 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:13.635556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:13.681327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:13.681903 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:13.682610 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lazy-loading 'fault' on Instance uuid ffd77532-d88b-4fc0-8ffd-81bc169e55db {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:13.762459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df3cf8a2f7c54b80aac61d6ca59672b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67dae2f388bc4a81bc957f48b1b02e42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:13.778015 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-510f3d5b-afbb-4c43-a3f7-ed223105e2b9 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 200 len: 1312 microversion: 2.1 time: 0.160791 May 10 20:33:13.779165 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 385/796] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:13 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:14.797308 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:14.798145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] [instance: ffd77532-d88b-4fc0-8ffd-81bc169e55db] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:14.805555 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:14.806007 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:14.806828 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:14.807266 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:14.821184 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] HTTP exception thrown: Instance ffd77532-d88b-4fc0-8ffd-81bc169e55db could not be found. May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Request method failure captured: May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db HTTP/1.1 May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesq0Vc_JFx25RDdGrab6G1Iqu_JtPPyOBfXB8fkoV9jcyK650upwuLU5hG6oDEdqSuuvbiquU2zsKAUQg3ZRDYCridJB_yYopyk0JTkLq68JtvfMdR6Gly2BpmcpOsEo14_p6IHGfWiEfacS-oEsbkwH3bvVn6fY4ezHZcjBsuf-y7g May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:14.822830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_67dae2f388bc4a81bc957f48b1b02e42", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/67dae2f388bc4a81bc957f48b1b02e42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 67dae2f388bc4a81bc957f48b1b02e42 May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1386521700 May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: df3cf8a2f7c54b80aac61d6ca59672b5 May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1386521700-project May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance ffd77532-d88b-4fc0-8ffd-81bc169e55db could not be found. May 10 20:33:14.824316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'ffd77532-d88b-4fc0-8ffd-81bc169e55db'} May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffd77532-d88b-4fc0-8ffd-81bc169e55db could not be found. May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:14.825228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffd77532-d88b-4fc0-8ffd-81bc169e55db could not be found. May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffd77532-d88b-4fc0-8ffd-81bc169e55db could not be found. May 10 20:33:14.826406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:14.827526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] Returning 404 to user: Instance ffd77532-d88b-4fc0-8ffd-81bc169e55db could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:14.827526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e09082cb-dca7-4015-9be1-0ef24747f7e4 tempest-ServerRescueNegativeTestJSON-1386521700 tempest-ServerRescueNegativeTestJSON-1386521700-project] 10.222.0.61 "GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db" status: 404 len: 111 microversion: 2.1 time: 0.032283 May 10 20:33:14.827526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 412/797] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:14 2022] GET /compute/v2.1/servers/ffd77532-d88b-4fc0-8ffd-81bc169e55db => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:20.287674 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3937f663-6f0b-4351-9bcc-db518f603dd4 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Action: 'create', calling method: .version_select at 0x7fb2781fdca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-466549398", "metadata": {"Type": "work"}}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3937f663-6f0b-4351-9bcc-db518f603dd4 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Request method failure captured: May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 121 May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABieswQjQLaa3q21MHUo4e8klle2CWX4yG1OxtbP8wwz5vRd19B_K5JhCk7r8GSJBTMJ3c1HBU_CHolmROF7clRcQu9OS8Hby4wHDxv2ElDrAOE1bJqIxXfE5gzsXJqPpkXCXEvCyicLmvgZmYQAil3L400DLoyxdBvJAIBqyVsz5N3AK0 May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:20.303893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c4e547f4ac949e29f6cc6fd6b9e1027", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: eda02a88b79a4e05a6cadfb1f89639b1 May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-466549398", "metadata": {"Type": "work"}}} May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: May 10 20:33:20.305427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-466549398', 'metadata': {'Type': 'work'}}}} May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise error May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi '#$%' May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:20.306354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 20:33:20.307924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 20:33:20.309135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 20:33:20.309135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.309135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3937f663-6f0b-4351-9bcc-db518f603dd4 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:20.309135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3937f663-6f0b-4351-9bcc-db518f603dd4 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136346 May 10 20:33:20.309135 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 386/798] 10.222.0.61 () {60 vars in 1155 bytes} [Tue May 10 20:33:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:33:20.315243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-96a1a509-7140-40d7-9726-9075aef3748b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Action: 'create', calling method: .version_select at 0x7fb27325b790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-481851571", "metadata": {"Type": "work"}}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-96a1a509-7140-40d7-9726-9075aef3748b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Request method failure captured: May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 119 May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABieswQjQLaa3q21MHUo4e8klle2CWX4yG1OxtbP8wwz5vRd19B_K5JhCk7r8GSJBTMJ3c1HBU_CHolmROF7clRcQu9OS8Hby4wHDxv2ElDrAOE1bJqIxXfE5gzsXJqPpkXCXEvCyicLmvgZmYQAil3L400DLoyxdBvJAIBqyVsz5N3AK0 May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:20.318609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c4e547f4ac949e29f6cc6fd6b9e1027", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: eda02a88b79a4e05a6cadfb1f89639b1 May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-481851571", "metadata": {"Type": "work"}}} May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: May 10 20:33:20.320063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-481851571', 'metadata': {'Type': 'work'}}}} May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise error May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi '0' May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:20.321113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 20:33:20.322646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 20:33:20.323792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 20:33:20.323792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.323792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-96a1a509-7140-40d7-9726-9075aef3748b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:20.323792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-96a1a509-7140-40d7-9726-9075aef3748b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009107 May 10 20:33:20.323792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 413/799] 10.222.0.61 () {60 vars in 1155 bytes} [Tue May 10 20:33:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:33:20.329284 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d8170119-4044-4b9c-9318-8335491d94d3 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Action: 'create', calling method: .version_select at 0x7fb27813fca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2029080631", "metadata": {"Type": "work"}}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d8170119-4044-4b9c-9318-8335491d94d3 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Request method failure captured: May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 119 May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABieswQjQLaa3q21MHUo4e8klle2CWX4yG1OxtbP8wwz5vRd19B_K5JhCk7r8GSJBTMJ3c1HBU_CHolmROF7clRcQu9OS8Hby4wHDxv2ElDrAOE1bJqIxXfE5gzsXJqPpkXCXEvCyicLmvgZmYQAil3L400DLoyxdBvJAIBqyVsz5N3AK0 May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:20.332141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c4e547f4ac949e29f6cc6fd6b9e1027", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: eda02a88b79a4e05a6cadfb1f89639b1 May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2029080631", "metadata": {"Type": "work"}}} May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: May 10 20:33:20.334549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2029080631', 'metadata': {'Type': 'work'}}}} May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise error May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi '' May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:20.335914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 20:33:20.338885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 20:33:20.341051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 20:33:20.341051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.341051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d8170119-4044-4b9c-9318-8335491d94d3 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:20.341051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d8170119-4044-4b9c-9318-8335491d94d3 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007875 May 10 20:33:20.341051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 387/800] 10.222.0.61 () {60 vars in 1155 bytes} [Tue May 10 20:33:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:33:20.343217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e07c94c6-a5dc-487f-9542-52f1cef9095b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Calling method '.version_select at 0x7fb273151040>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:20.370734 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-e07c94c6-a5dc-487f-9542-52f1cef9095b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] HTTP exception thrown: Volume tempest-invalid-999088808 could not be found. May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e07c94c6-a5dc-487f-9542-52f1cef9095b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Request method failure captured: May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-999088808 HTTP/1.1 May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABieswQjQLaa3q21MHUo4e8klle2CWX4yG1OxtbP8wwz5vRd19B_K5JhCk7r8GSJBTMJ3c1HBU_CHolmROF7clRcQu9OS8Hby4wHDxv2ElDrAOE1bJqIxXfE5gzsXJqPpkXCXEvCyicLmvgZmYQAil3L400DLoyxdBvJAIBqyVsz5N3AK0 May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:20.372696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c4e547f4ac949e29f6cc6fd6b9e1027", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: eda02a88b79a4e05a6cadfb1f89639b1 May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Volume tempest-invalid-999088808 could not be found. May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'tempest-invalid-999088808'} May 10 20:33:20.374781 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-999088808 could not be found. (HTTP 404) (Request-ID: req-1bd9026a-4a9e-4d3d-9da6-786443904944) May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.375694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:33:20.377045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-999088808 could not be found. May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:20.378321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-999088808 could not be found. May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-999088808 could not be found. May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e07c94c6-a5dc-487f-9542-52f1cef9095b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Returning 404 to user: Volume tempest-invalid-999088808 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e07c94c6-a5dc-487f-9542-52f1cef9095b tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-999088808" status: 404 len: 98 microversion: 2.1 time: 0.035273 May 10 20:33:20.379631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 414/801] 10.222.0.61 () {58 vars in 1214 bytes} [Tue May 10 20:33:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-999088808 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 10 20:33:20.384509 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f726122d-67d1-4f36-ac20-1106cd09b56f tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003700 May 10 20:33:20.385046 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 388/802] 10.222.0.61 () {58 vars in 1139 bytes} [Tue May 10 20:33:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 20:33:20.393053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3c3c8cbf-862e-4e71-8dd0-1f6cd19c1454 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003693 May 10 20:33:20.393634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 415/803] 10.222.0.61 () {58 vars in 1136 bytes} [Tue May 10 20:33:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 20:33:20.401713 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dc27427f-437c-43cd-ba7b-97b2b4436ef7 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Calling method '.version_select at 0x7fb27821ce50>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:20.428954 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-dc27427f-437c-43cd-ba7b-97b2b4436ef7 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] HTTP exception thrown: Volume 2aaf5bd3-a63d-4694-a817-478e6b0b7106 could not be found. May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dc27427f-437c-43cd-ba7b-97b2b4436ef7 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Request method failure captured: May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/os-volumes/2aaf5bd3-a63d-4694-a817-478e6b0b7106 HTTP/1.1 May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABieswQjQLaa3q21MHUo4e8klle2CWX4yG1OxtbP8wwz5vRd19B_K5JhCk7r8GSJBTMJ3c1HBU_CHolmROF7clRcQu9OS8Hby4wHDxv2ElDrAOE1bJqIxXfE5gzsXJqPpkXCXEvCyicLmvgZmYQAil3L400DLoyxdBvJAIBqyVsz5N3AK0 May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:20.430908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c4e547f4ac949e29f6cc6fd6b9e1027", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: eda02a88b79a4e05a6cadfb1f89639b1 May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Volume 2aaf5bd3-a63d-4694-a817-478e6b0b7106 could not be found. May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '2aaf5bd3-a63d-4694-a817-478e6b0b7106'} May 10 20:33:20.432359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2aaf5bd3-a63d-4694-a817-478e6b0b7106 could not be found. (HTTP 404) (Request-ID: req-3c8563ef-953f-455c-9101-e0bcd331be54) May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.433349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 20:33:20.434651 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2aaf5bd3-a63d-4694-a817-478e6b0b7106 could not be found. May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 20:33:20.435982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2aaf5bd3-a63d-4694-a817-478e6b0b7106 could not be found. May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2aaf5bd3-a63d-4694-a817-478e6b0b7106 could not be found. May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dc27427f-437c-43cd-ba7b-97b2b4436ef7 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Returning 404 to user: Volume 2aaf5bd3-a63d-4694-a817-478e6b0b7106 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-dc27427f-437c-43cd-ba7b-97b2b4436ef7 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/2aaf5bd3-a63d-4694-a817-478e6b0b7106" status: 404 len: 109 microversion: 2.1 time: 0.034002 May 10 20:33:20.437327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 389/804] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:33:20 2022] DELETE /compute/v2.1/os-volumes/2aaf5bd3-a63d-4694-a817-478e6b0b7106 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:20.441610 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6effc171-263f-411b-beef-36d665218165 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Calling method '.version_select at 0x7fb27325b940>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:20.467306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-6effc171-263f-411b-beef-36d665218165 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] HTTP exception thrown: Volume 003b92f2-24c3-441e-bf64-14456dcf9748 could not be found. May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6effc171-263f-411b-beef-36d665218165 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Request method failure captured: May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/os-volumes/003b92f2-24c3-441e-bf64-14456dcf9748 HTTP/1.1 May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABieswQjQLaa3q21MHUo4e8klle2CWX4yG1OxtbP8wwz5vRd19B_K5JhCk7r8GSJBTMJ3c1HBU_CHolmROF7clRcQu9OS8Hby4wHDxv2ElDrAOE1bJqIxXfE5gzsXJqPpkXCXEvCyicLmvgZmYQAil3L400DLoyxdBvJAIBqyVsz5N3AK0 May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:20.469741 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2c4e547f4ac949e29f6cc6fd6b9e1027", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2c4e547f4ac949e29f6cc6fd6b9e1027"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 2c4e547f4ac949e29f6cc6fd6b9e1027 May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-VolumesNegativeTest-639406731 May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: eda02a88b79a4e05a6cadfb1f89639b1 May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-VolumesNegativeTest-639406731-project May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Volume 003b92f2-24c3-441e-bf64-14456dcf9748 could not be found. May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '003b92f2-24c3-441e-bf64-14456dcf9748'} May 10 20:33:20.471221 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 003b92f2-24c3-441e-bf64-14456dcf9748 could not be found. (HTTP 404) (Request-ID: req-5be09a75-6d43-43d8-936a-6efeb88ff56d) May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.472151 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 20:33:20.473576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 003b92f2-24c3-441e-bf64-14456dcf9748 could not be found. May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 20:33:20.474758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 003b92f2-24c3-441e-bf64-14456dcf9748 could not be found. May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 003b92f2-24c3-441e-bf64-14456dcf9748 could not be found. May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6effc171-263f-411b-beef-36d665218165 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] Returning 404 to user: Volume 003b92f2-24c3-441e-bf64-14456dcf9748 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6effc171-263f-411b-beef-36d665218165 tempest-VolumesNegativeTest-639406731 tempest-VolumesNegativeTest-639406731-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/003b92f2-24c3-441e-bf64-14456dcf9748" status: 404 len: 109 microversion: 2.1 time: 0.033154 May 10 20:33:20.475956 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 416/805] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:33:20 2022] GET /compute/v2.1/os-volumes/003b92f2-24c3-441e-bf64-14456dcf9748 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:23.387414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b6023803-ac0e-49f8-8893-54a2e1810dd9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:23.387961 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b6023803-ac0e-49f8-8893-54a2e1810dd9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:23.394232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6023803-ac0e-49f8-8893-54a2e1810dd9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:23.394690 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6023803-ac0e-49f8-8893-54a2e1810dd9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:23.395475 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6023803-ac0e-49f8-8893-54a2e1810dd9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:23.395923 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b6023803-ac0e-49f8-8893-54a2e1810dd9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:23.418812 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b6023803-ac0e-49f8-8893-54a2e1810dd9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/ips" status: 200 len: 147 microversion: 2.1 time: 0.036303 May 10 20:33:23.419390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 390/806] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:33:23 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:24.729373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-59b06570-abd3-492f-8bf6-134d650cb066 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f9804e1-877a-4c47-8571-bbf213fd6d76"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:24.730465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-59b06570-abd3-492f-8bf6-134d650cb066 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:24.736823 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59b06570-abd3-492f-8bf6-134d650cb066 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:24.737303 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59b06570-abd3-492f-8bf6-134d650cb066 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:24.738087 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59b06570-abd3-492f-8bf6-134d650cb066 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:24.738523 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-59b06570-abd3-492f-8bf6-134d650cb066 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:24.977237 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-59b06570-abd3-492f-8bf6-134d650cb066 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254310 May 10 20:33:24.978233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 417/807] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:33:24 2022] POST /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:26.308133 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6900ed1b-0b08-494c-a2a6-31bfc7f39ee2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:26.308712 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6900ed1b-0b08-494c-a2a6-31bfc7f39ee2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:26.315186 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6900ed1b-0b08-494c-a2a6-31bfc7f39ee2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:26.315643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6900ed1b-0b08-494c-a2a6-31bfc7f39ee2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:26.316418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6900ed1b-0b08-494c-a2a6-31bfc7f39ee2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:26.316856 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6900ed1b-0b08-494c-a2a6-31bfc7f39ee2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:26.341710 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6900ed1b-0b08-494c-a2a6-31bfc7f39ee2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/ips" status: 200 len: 152 microversion: 2.20 time: 0.038021 May 10 20:33:26.342300 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 391/808] 10.222.0.61 () {60 vars in 1288 bytes} [Tue May 10 20:33:26 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:33:28.171030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:28.171646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:28.178189 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:28.178645 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:28.179413 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:28.179852 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:28.202983 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lazy-loading 'flavor' on Instance uuid efd776b6-60d4-4205-ac05-bfdb5b92c4b9 {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:28.452656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4c695bef-68f5-4b94-aa1c-d8baf9fb4dd3 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/action" status: 202 len: 0 microversion: 2.20 time: 0.285586 May 10 20:33:28.453393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 418/809] 10.222.0.61 () {62 vars in 1318 bytes} [Tue May 10 20:33:28 2022] POST /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:33:28.462685 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:28.463321 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:28.469945 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:28.470509 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:28.471399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:28.471841 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:28.599662 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:28.607724 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:28.609890 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:28.611039 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4d9f1089-b7d8-4346-9b59-cc9d315a775b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.152192 May 10 20:33:28.611588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 392/810] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:28 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:29.630845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:29.631549 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:29.637770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:29.638223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:29.638996 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:29.639998 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:29.768126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:29.776113 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:29.777712 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:29.778871 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a837ce9d-4d84-4e1d-9452-3a9c7d3c605b tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.152793 May 10 20:33:29.779461 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 419/811] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:29 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:30.796870 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:30.797519 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:30.803576 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:30.804032 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:30.804913 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:30.805471 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:30.928184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:30.936406 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:30.937949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:30.939106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-30e39693-c0d1-4f3b-954f-3d41af05e66c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.146183 May 10 20:33:30.939665 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 393/812] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:30 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:31.957751 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:31.958293 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:31.965112 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:31.965562 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:31.966341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:31.966774 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:32.099621 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:32.107406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:32.109450 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:32.110602 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ca5b5da7-c2d9-425f-bbbb-ece67bb02817 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.156879 May 10 20:33:32.111164 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 420/813] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:31 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:32.455102 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-66eefcad-2690-42b8-ad6a-ff62404d8ced tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:32.456080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-66eefcad-2690-42b8-ad6a-ff62404d8ced tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:32.462670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-66eefcad-2690-42b8-ad6a-ff62404d8ced tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:32.463058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-66eefcad-2690-42b8-ad6a-ff62404d8ced tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:32.463835 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-66eefcad-2690-42b8-ad6a-ff62404d8ced tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:32.464461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-66eefcad-2690-42b8-ad6a-ff62404d8ced tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:32.499240 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-66eefcad-2690-42b8-ad6a-ff62404d8ced tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049482 May 10 20:33:32.499929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 394/814] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:33:32 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:32.510250 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-189fce68-d383-4ae3-ab28-83e9541086c5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:32.511063 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-189fce68-d383-4ae3-ab28-83e9541086c5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:32.517369 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-189fce68-d383-4ae3-ab28-83e9541086c5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:32.518004 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-189fce68-d383-4ae3-ab28-83e9541086c5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:32.519194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-189fce68-d383-4ae3-ab28-83e9541086c5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:32.519790 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-189fce68-d383-4ae3-ab28-83e9541086c5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:32.551378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-189fce68-d383-4ae3-ab28-83e9541086c5 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/9f9804e1-877a-4c47-8571-bbf213fd6d76" status: 200 len: 194 microversion: 2.1 time: 0.044950 May 10 20:33:32.551967 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 421/815] 10.222.0.61 () {58 vars in 1412 bytes} [Tue May 10 20:33:32 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/9f9804e1-877a-4c47-8571-bbf213fd6d76 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:33.129402 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:33.130030 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:33.135884 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:33.136333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:33.137127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:33.137563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:33.261776 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:33.270394 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:33.271904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:33.273095 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d4d87d9c-0b2a-424a-a8ef-788c4144e3b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.147807 May 10 20:33:33.273660 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 395/816] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:33 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:33.859420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e2867bad-5580-4a90-a653-cd8bfffe4d9e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6925cdca-5f0a-4a6e-9961-e3e24587e65f"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:33.860539 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e2867bad-5580-4a90-a653-cd8bfffe4d9e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:33.866836 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2867bad-5580-4a90-a653-cd8bfffe4d9e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:33.867288 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2867bad-5580-4a90-a653-cd8bfffe4d9e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:33.868057 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2867bad-5580-4a90-a653-cd8bfffe4d9e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:33.868496 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2867bad-5580-4a90-a653-cd8bfffe4d9e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:34.099385 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e2867bad-5580-4a90-a653-cd8bfffe4d9e tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "POST /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244232 May 10 20:33:34.099989 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 422/817] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:33:33 2022] POST /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:34.290295 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:34.290914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:34.297814 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:34.298271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:34.299046 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:34.299488 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:34.423510 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:34.431760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:34.433336 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:34.434528 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-dd00f03f-a576-42e8-9701-9297e4b398a8 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.148184 May 10 20:33:34.435160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 396/818] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:34 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:35.453974 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:35.454785 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:35.460868 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:35.461350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:35.462119 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:35.462558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:35.590491 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:35.599571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:35.601093 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:35.602246 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8abc8feb-252b-46ff-8ebc-78cbd8303c58 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.153079 May 10 20:33:35.602808 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 423/819] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:35 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:36.620668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:36.621292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:36.628152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:36.628616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:36.629388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:36.629822 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:36.752658 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:36.760329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:36.761853 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:36.762995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-48c34616-978b-4bdc-a6c6-595fd73065e0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.146219 May 10 20:33:36.763553 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 397/820] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:36 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:37.781256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:37.781806 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:37.789086 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:37.789543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:37.790326 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:37.790804 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:37.926845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:37.934727 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:37.936888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:37.938145 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-018b1669-b2ff-47d2-ba8f-b9e4ac8a4371 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.160940 May 10 20:33:37.938786 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 424/821] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:37 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:38.956390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:38.957177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:38.963480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:38.963944 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:38.968084 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:38.968084 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:39.098558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:39.106394 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:39.107896 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:39.109067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1d75d593-7915-4332-866d-a900fe3f9543 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.156928 May 10 20:33:39.109624 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 398/822] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:38 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:40.126881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:40.127568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:40.133790 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:40.134241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:40.135011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:40.135451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:40.263266 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:40.271809 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:40.273327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:40.274477 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-90d7abca-cae5-41d9-9a01-b1a717948dc4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.151451 May 10 20:33:40.275043 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 425/823] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:40 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:41.297657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:41.298182 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:41.304498 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.304955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.305797 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.306236 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.434427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:41.442682 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:41.444166 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:41.445351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b291b727-c6b5-4607-b369-167446aaa237 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.151742 May 10 20:33:41.445912 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 399/824] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:41 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:41.576870 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f1a8f330-32cd-44ca-9324-6cfe8844131f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:41.577854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f1a8f330-32cd-44ca-9324-6cfe8844131f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:41.584102 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1a8f330-32cd-44ca-9324-6cfe8844131f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.584553 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1a8f330-32cd-44ca-9324-6cfe8844131f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.585347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1a8f330-32cd-44ca-9324-6cfe8844131f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.585782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1a8f330-32cd-44ca-9324-6cfe8844131f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.613716 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f1a8f330-32cd-44ca-9324-6cfe8844131f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041379 May 10 20:33:41.614254 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 426/825] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:33:41 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments => generated 371 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:41.752733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1bb3d14a-c798-4824-90d9-cf3057d6de15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:41.753266 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1bb3d14a-c798-4824-90d9-cf3057d6de15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:41.759287 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bb3d14a-c798-4824-90d9-cf3057d6de15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.759744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bb3d14a-c798-4824-90d9-cf3057d6de15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.760522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bb3d14a-c798-4824-90d9-cf3057d6de15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.760989 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bb3d14a-c798-4824-90d9-cf3057d6de15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.789350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1bb3d14a-c798-4824-90d9-cf3057d6de15 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/9f9804e1-877a-4c47-8571-bbf213fd6d76" status: 200 len: 194 microversion: 2.1 time: 0.041090 May 10 20:33:41.789921 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 400/826] 10.222.0.61 () {58 vars in 1412 bytes} [Tue May 10 20:33:41 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/9f9804e1-877a-4c47-8571-bbf213fd6d76 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:41.799809 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:41.800300 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:41.806306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.806695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.807460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:41.807894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:41.884181 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lazy-loading 'services' on Instance uuid fe946939-f5a9-4b1a-abf1-0753f505d60f {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:41.952080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c63506f7-c431-4760-84f0-d1b27ce49469 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/9f9804e1-877a-4c47-8571-bbf213fd6d76" status: 202 len: 0 microversion: 2.1 time: 0.156025 May 10 20:33:41.952681 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 427/827] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:33:41 2022] DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/9f9804e1-877a-4c47-8571-bbf213fd6d76 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:33:42.463987 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:42.464594 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:42.471366 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:42.471811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:42.472570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:42.473019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:42.598634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:42.606315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:42.607846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:42.609068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ff45d80e-3e13-47b3-b848-33bfa92c6d89 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.148901 May 10 20:33:42.609631 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 401/828] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:42 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:43.064624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-60a67b54-b9b7-49f1-aa8e-3a3d6e0e57a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:43.065246 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-60a67b54-b9b7-49f1-aa8e-3a3d6e0e57a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:43.071492 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60a67b54-b9b7-49f1-aa8e-3a3d6e0e57a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:43.071942 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60a67b54-b9b7-49f1-aa8e-3a3d6e0e57a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:43.072720 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60a67b54-b9b7-49f1-aa8e-3a3d6e0e57a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:43.073199 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-60a67b54-b9b7-49f1-aa8e-3a3d6e0e57a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:43.101447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-60a67b54-b9b7-49f1-aa8e-3a3d6e0e57a9 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/6925cdca-5f0a-4a6e-9961-e3e24587e65f" status: 200 len: 194 microversion: 2.1 time: 0.042046 May 10 20:33:43.102024 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 428/829] 10.222.0.61 () {58 vars in 1412 bytes} [Tue May 10 20:33:43 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/6925cdca-5f0a-4a6e-9961-e3e24587e65f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:43.111753 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:43.112251 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:43.118093 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:43.118545 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:43.119312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:43.119753 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:43.196692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lazy-loading 'services' on Instance uuid fe946939-f5a9-4b1a-abf1-0753f505d60f {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:43.267206 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-32546c94-5eb0-4552-bc81-f47b7bb141cd tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/6925cdca-5f0a-4a6e-9961-e3e24587e65f" status: 202 len: 0 microversion: 2.1 time: 0.159161 May 10 20:33:43.267830 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 402/830] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:33:43 2022] DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments/6925cdca-5f0a-4a6e-9961-e3e24587e65f => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:33:43.627875 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:43.628476 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:43.634433 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:43.634884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:43.635644 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:43.636078 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:43.765607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:43.773895 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:43.775393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:43.776544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5d25a29b-dafa-4306-b6ea-e8a57938dfec tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.152562 May 10 20:33:43.777132 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 429/831] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:43 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:44.431251 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-788226b1-13ad-4ec8-8973-c6bfdc3ead87 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:44.432260 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-788226b1-13ad-4ec8-8973-c6bfdc3ead87 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:44.438480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-788226b1-13ad-4ec8-8973-c6bfdc3ead87 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.438935 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-788226b1-13ad-4ec8-8973-c6bfdc3ead87 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.439716 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-788226b1-13ad-4ec8-8973-c6bfdc3ead87 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.440162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-788226b1-13ad-4ec8-8973-c6bfdc3ead87 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.468026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-788226b1-13ad-4ec8-8973-c6bfdc3ead87 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041576 May 10 20:33:44.468579 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 403/832] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:33:44 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:33:44.572559 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-293b9254-1d86-4556-9280-980d8e6a39a3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:44.573582 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-293b9254-1d86-4556-9280-980d8e6a39a3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:44.579881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-293b9254-1d86-4556-9280-980d8e6a39a3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.580340 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-293b9254-1d86-4556-9280-980d8e6a39a3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.582913 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-293b9254-1d86-4556-9280-980d8e6a39a3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.582913 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-293b9254-1d86-4556-9280-980d8e6a39a3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.616034 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-293b9254-1d86-4556-9280-980d8e6a39a3 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047291 May 10 20:33:44.616604 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 430/833] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:33:44 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:33:44.683003 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:44.683507 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:44.690325 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.690781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.691553 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.691988 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.717139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:33:44.798859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:44.800614 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:44.809930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.810874 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.812447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.813548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.816396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c7cb4a01-60f4-4fdf-8251-c3d48927d917 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 204 len: 0 microversion: 2.1 time: 0.137650 May 10 20:33:44.817326 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 404/834] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:33:44 2022] DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:33:44.828549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:44.829535 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:44.836256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.836831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:44.837793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:44.838336 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:45.044779 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:45.046318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:45.055148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f0bd38f4-5877-4a8f-8f71-5811ce7cd787 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1675 microversion: 2.1 time: 0.231347 May 10 20:33:45.055467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:45.057390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:45.058821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6a09e022-25af-4b92-bb21-c62806217e60 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1745 microversion: 2.20 time: 0.267312 May 10 20:33:45.059546 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 431/835] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:44 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1745 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:33:45.061653 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 405/836] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:44 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:46.074443 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:46.075076 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:46.079389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:46.080077 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:46.081465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:46.081917 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:46.082697 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:46.083131 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:46.086387 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:46.086919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:46.087695 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:46.088314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:46.271764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:46.274908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:46.280378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:46.281895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:46.282881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a7549e59-c80c-4bcd-b639-fd8d1e0d784f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1675 microversion: 2.1 time: 0.212372 May 10 20:33:46.283085 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fbf62c18-ed61-4559-9b41-6de5966bf35c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1745 microversion: 2.20 time: 0.207625 May 10 20:33:46.283640 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 406/838] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:46 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1745 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:33:46.283828 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 432/838] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:46 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1675 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:47.300722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:47.301396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:47.306775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-38cce2a1-11fc-4a25-8e23-99cb81bff057 req-2084ea40-01ce-4e24-8b02-9238c1eab35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd776b6-60d4-4205-ac05-bfdb5b92c4b9", "name": "network-vif-plugged", "status": "completed", "tag": "f9a5ff83-f76c-42b5-8831-862bc9d49d17"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:47.311896 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:47.312662 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:47.313496 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:47.313924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:47.321223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-38cce2a1-11fc-4a25-8e23-99cb81bff057 req-2084ea40-01ce-4e24-8b02-9238c1eab35f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:47.322359 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-38cce2a1-11fc-4a25-8e23-99cb81bff057 req-2084ea40-01ce-4e24-8b02-9238c1eab35f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:47.338364 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-38cce2a1-11fc-4a25-8e23-99cb81bff057 req-2084ea40-01ce-4e24-8b02-9238c1eab35f service nova] Creating event network-vif-plugged:f9a5ff83-f76c-42b5-8831-862bc9d49d17 for instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 on hv-cinder-82880 May 10 20:33:47.350401 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-38cce2a1-11fc-4a25-8e23-99cb81bff057 req-2084ea40-01ce-4e24-8b02-9238c1eab35f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212016 May 10 20:33:47.352220 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 433/839] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:47.359290 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:47.360157 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:47.366936 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:47.367606 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:47.368541 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:47.369163 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:47.615758 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:47.623777 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3f177c1f-9c55-4b77-b6be-42cbaf1e0fa7 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1675 microversion: 2.1 time: 0.327309 May 10 20:33:47.627197 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 407/840] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:47 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:47.663457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:47.675599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:47.677347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:47.678706 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2a8dd3f9-fe98-4002-b5df-1539d8f128b0 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.325162 May 10 20:33:47.679454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 434/841] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:47 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:48.022877 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:48.024274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:48.036156 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.037897 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.039158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.039938 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.128188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:33:48.168645 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-0fd89d4d-25d5-47df-a22c-c9b7d7104b5a req-e70f1a30-e9ee-4ff2-99c8-5867e1fb6178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe946939-f5a9-4b1a-abf1-0753f505d60f", "name": "network-vif-deleted", "tag": "f4759d7e-1e14-4fe1-9952-e0b7da16106f"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:48.182894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0fd89d4d-25d5-47df-a22c-c9b7d7104b5a req-e70f1a30-e9ee-4ff2-99c8-5867e1fb6178 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.183291 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0fd89d4d-25d5-47df-a22c-c9b7d7104b5a req-e70f1a30-e9ee-4ff2-99c8-5867e1fb6178 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.197038 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-0fd89d4d-25d5-47df-a22c-c9b7d7104b5a req-e70f1a30-e9ee-4ff2-99c8-5867e1fb6178 service nova] Creating event network-vif-deleted:f4759d7e-1e14-4fe1-9952-e0b7da16106f for instance fe946939-f5a9-4b1a-abf1-0753f505d60f on hv-cinder-82880 May 10 20:33:48.210733 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-0fd89d4d-25d5-47df-a22c-c9b7d7104b5a req-e70f1a30-e9ee-4ff2-99c8-5867e1fb6178 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051313 May 10 20:33:48.211372 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 435/842] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:48.289087 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e57ae136-eb45-4608-aa66-9cb26d3e7439 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 204 len: 0 microversion: 2.1 time: 0.283742 May 10 20:33:48.296619 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 408/843] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:33:48 2022] DELETE /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 20:33:48.306020 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:48.307325 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:48.316612 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.317453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.319169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.319914 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.550875 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:48.563965 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-87e4f415-9de2-40b4-b3dd-44ccb1faa9b8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1578 microversion: 2.1 time: 0.265586 May 10 20:33:48.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 436/844] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:48 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1578 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:48.658009 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:48.658714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:48.670030 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.670485 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.671272 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.671708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.699006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:48.700041 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:48.710841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.711302 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.715156 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.715629 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.764152 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:48.766538 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:48.769508 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lazy-loading 'fault' on Instance uuid fe946939-f5a9-4b1a-abf1-0753f505d60f {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:48.944469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:48.952566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:48.954108 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:48.955244 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-47db6161-39e5-427a-8d1b-497085570d50 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.261392 May 10 20:33:48.962632 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:48.969828 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 437/845] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:48 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:33:48.979974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-622614fa-7366-4396-8de7-712d808132d4 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1327 microversion: 2.1 time: 0.327286 May 10 20:33:48.994240 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 409/846] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:48 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1327 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:49.584424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:49.585276 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:49.594018 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:49.598047 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:49.601495 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:49.602156 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:49.823381 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:49.837895 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a23d9ac4-2aa9-43f0-ada0-700aa3e35d03 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1578 microversion: 2.1 time: 0.253670 May 10 20:33:49.847328 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 438/847] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:49 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1578 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:49.981519 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:49.982808 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:50.003686 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:50.005006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:50.005552 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:50.005978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:50.008966 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:50.009504 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:50.018726 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:50.019598 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:50.022775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:50.025168 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:50.274555 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:50.283571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:50.290833 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:50.298896 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fd013415-ed4e-4a3e-9178-db34302100e6 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.320484 May 10 20:33:50.300214 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 410/848] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:49 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:50.418637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:50.419126 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:50.420469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lazy-loading 'fault' on Instance uuid fe946939-f5a9-4b1a-abf1-0753f505d60f {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:50.480847 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e092796100394b63a7304abae7e25f7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '638a84064b2244e0b938b063e13cb944', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:50.489256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6fb1ee72-5cab-40db-811f-4a216f8b9d92 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 200 len: 1327 microversion: 2.1 time: 0.492351 May 10 20:33:50.490504 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 439/849] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:49 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 1327 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:50.855369 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:50.857134 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:50.877244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:50.877947 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:50.879142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:50.880362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:50.968611 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:50.988384 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9cd3c8fc-e63c-444c-8196-0ca723d3001d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1510 microversion: 2.1 time: 0.137070 May 10 20:33:50.994881 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 411/850] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:50 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1510 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:51.270192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-bd711a29-37d2-425a-8354-572ed3bab340 req-3b192fbc-7cd6-4258-a165-3a919696d92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9", "name": "network-vif-deleted", "tag": "ef5b3996-8a16-4831-b6f6-94b31b5af88d"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:51.290999 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-bd711a29-37d2-425a-8354-572ed3bab340 req-3b192fbc-7cd6-4258-a165-3a919696d92e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:51.292334 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-bd711a29-37d2-425a-8354-572ed3bab340 req-3b192fbc-7cd6-4258-a165-3a919696d92e service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:51.320744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:51.321526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:51.325258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-bd711a29-37d2-425a-8354-572ed3bab340 req-3b192fbc-7cd6-4258-a165-3a919696d92e service nova] Creating event network-vif-deleted:ef5b3996-8a16-4831-b6f6-94b31b5af88d for instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 on hv-cinder-82880 May 10 20:33:51.332021 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:51.334279 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:51.335484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:51.336107 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:51.337448 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-bd711a29-37d2-425a-8354-572ed3bab340 req-3b192fbc-7cd6-4258-a165-3a919696d92e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074090 May 10 20:33:51.341552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 440/851] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:51.507707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:51.508864 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:51.533927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:51.535654 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:51.536539 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:51.539192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:51.568945 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] HTTP exception thrown: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Request method failure captured: May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f HTTP/1.1 May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesqxi7V7XQA-k3rei_g2ZjFTN-zC7UGE1zcdZWO1gtdINDX1p0LiJWapE1vvPb-f2n8rWegW6AZxma-oWwvjrIkxtj2002-kMYxpRAoRlwXAQxONMg_TY-1dGCqukZtbWqe0ireN0hujGIn6Dy4NWJr3WUnyb0SOWZGodMqtXIGDHO4 May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:33:51.574649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/638a84064b2244e0b938b063e13cb944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_638a84064b2244e0b938b063e13cb944", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: e092796100394b63a7304abae7e25f7d May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:51.576167 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'fe946939-f5a9-4b1a-abf1-0753f505d60f'} May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:51.576960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:51.579333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:33:51.580899 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Returning 404 to user: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:51.580899 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-26eeb7f1-5e70-4eef-9d57-434ac2ddfeb8 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 404 len: 111 microversion: 2.1 time: 0.074335 May 10 20:33:51.582351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 441/852] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:51 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:51.606425 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-005538cf-88d8-483b-ae55-687f2264e73f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '.version_select at 0x7fb27325b0d0>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:51.628692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:51.643052 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:51.646520 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:51.648995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-589f3da3-ef61-4be5-bd09-a56e4a07657a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.332313 May 10 20:33:51.650161 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 412/853] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:51 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:33:51.661976 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-005538cf-88d8-483b-ae55-687f2264e73f tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748594223" status: 202 len: 0 microversion: 2.1 time: 0.074946 May 10 20:33:51.664497 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 442/854] 10.222.0.61 () {58 vars in 1220 bytes} [Tue May 10 20:33:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1748594223 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:33:52.011919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:52.013688 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:52.021026 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:52.023519 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:52.024522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:52.026791 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:52.114856 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:52.115587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:52.118495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lazy-loading 'fault' on Instance uuid a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:33:52.219793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:52.236644 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9d681080-6557-4c5f-8a3f-5f5e3b407e9b tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 200 len: 1229 microversion: 2.1 time: 0.227072 May 10 20:33:52.239050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 413/855] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:52 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 1229 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:52.666812 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:52.667434 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:52.676069 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:52.676986 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:52.677971 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:52.678750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:52.919278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:52.941913 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:52.945020 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:52.949154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0b3dc924-4cb0-457c-8ce7-ec2010277481 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.286664 May 10 20:33:52.966128 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 443/856] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:52 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:53.256292 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:53.256992 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:53.263692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:53.264144 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:53.264961 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:53.265469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:53.280771 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] HTTP exception thrown: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Request method failure captured: May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 HTTP/1.1 May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiestjjqsWupCZLQzvzeCyOmdiWgWqzCYUup5y-vXD1PJvvuPFHShl-ZbmQQXVAK1DcMrVdRRz6rR-XYIlekYi-RcSUiQYbruWQNMvc551Qp6Qdqh4N_JNLyGSMdwza6bssyr33ky6bHysNeBV_b-Bzd0-Qz6aSa37pTYEuj-QTisNPO4 May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:53.282904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_890bf13c89b748b3a8f9ba4106c582b3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-TestVolumeBootPattern-170457138 May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-TestVolumeBootPattern-170457138-project May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 17f6eadae19c4b7b8bd66e21ae302363 May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-TestVolumeBootPattern-170457138-project May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:33:53.284465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9'} May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:53.285414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:33:53.286842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:53.295006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Returning 404 to user: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:53.296182 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f9d48882-8c5d-4275-aff1-6b82f61ffa50 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 404 len: 111 microversion: 2.1 time: 0.043706 May 10 20:33:53.297284 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 414/857] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:53 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:53.409703 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-598626093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-786161446", "security_groups": [{"name": "tempest-secgroup-smoke-1677145085"}], "block_device_mapping_v2": [{"uuid": "1014ec4e-aeb1-4c38-87aa-2d8e23f432d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9d88ce3-6580-4789-923a-dc95426320f4"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:53.559810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] validate_networks() for [('f9d88ce3-6580-4789-923a-dc95426320f4', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:33:53.968438 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:53.969570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:53.975969 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:53.976423 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:53.977244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:53.978123 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:53.978543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:33:53.979533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:33:53.980563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:33:53.980998 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:33:53.981671 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:33:53.992219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:53.992682 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:53.993542 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:53.994159 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:54.021687 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:33:54.026043 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for user 17f6eadae19c4b7b8bd66e21ae302363 and project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:33:54.098346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:33:54.102247 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1014ec4e-aeb1-4c38-87aa-2d8e23f432d4',volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:33:54.158244 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:54.167892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:54.170067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:54.171962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-30756cb2-52bf-4e51-a8a5-efec96b91b84 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.208190 May 10 20:33:54.172956 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 415/858] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:53 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:33:54.321817 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f34b7e14-f9a1-4378-a771-2626f6cad37e tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.917831 May 10 20:33:54.322793 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 444/859] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:33:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:33:54.337675 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1762be95-b43a-4105-bfb3-98dae3c41830 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:54.341509 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1762be95-b43a-4105-bfb3-98dae3c41830 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:54.458738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1762be95-b43a-4105-bfb3-98dae3c41830 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:54.466927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1762be95-b43a-4105-bfb3-98dae3c41830 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1093 microversion: 2.1 time: 0.137033 May 10 20:33:54.467524 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 416/860] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:54 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1093 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:55.194933 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:55.195596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:55.206260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.206260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.206260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.206260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.377283 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:55.384219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:55.385976 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:55.387318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ed4b354e-a2d2-4481-bc97-afadacd0ed6e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.197299 May 10 20:33:55.399160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 445/861] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:55 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:55.465311 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:55.467445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:55.476486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.478738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.479687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.480426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.486096 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:55.486724 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:55.499177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] HTTP exception thrown: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Request method failure captured: May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f HTTP/1.1 May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqxi7V7XQA-k3rei_g2ZjFTN-zC7UGE1zcdZWO1gtdINDX1p0LiJWapE1vvPb-f2n8rWegW6AZxma-oWwvjrIkxtj2002-kMYxpRAoRlwXAQxONMg_TY-1dGCqukZtbWqe0ireN0hujGIn6Dy4NWJr3WUnyb0SOWZGodMqtXIGDHO4 May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:55.501993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/638a84064b2244e0b938b063e13cb944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_638a84064b2244e0b938b063e13cb944", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: e092796100394b63a7304abae7e25f7d May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.503418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'fe946939-f5a9-4b1a-abf1-0753f505d60f'} May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:55.504139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.508639 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.510142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Returning 404 to user: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:55.510142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e8ed8413-ec5f-49f8-9624-3392622e0e50 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 404 len: 111 microversion: 2.1 time: 0.044413 May 10 20:33:55.510369 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.510548 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 417/862] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:33:55 2022] DELETE /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:55.510628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.510628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.510628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.516399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:55.517800 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: fe946939-f5a9-4b1a-abf1-0753f505d60f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:55.528558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.529861 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.532584 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:55.533180 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:55.554586 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] HTTP exception thrown: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Request method failure captured: May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f HTTP/1.1 May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqxi7V7XQA-k3rei_g2ZjFTN-zC7UGE1zcdZWO1gtdINDX1p0LiJWapE1vvPb-f2n8rWegW6AZxma-oWwvjrIkxtj2002-kMYxpRAoRlwXAQxONMg_TY-1dGCqukZtbWqe0ireN0hujGIn6Dy4NWJr3WUnyb0SOWZGodMqtXIGDHO4 May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:55.568770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/638a84064b2244e0b938b063e13cb944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_638a84064b2244e0b938b063e13cb944", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: e092796100394b63a7304abae7e25f7d May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.570332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'fe946939-f5a9-4b1a-abf1-0753f505d60f'} May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:55.571038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. May 10 20:33:55.572223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:55.573347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Returning 404 to user: Instance fe946939-f5a9-4b1a-abf1-0753f505d60f could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:55.573347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e62ab7c8-0b51-4197-bfb8-dbf68999afaa tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f" status: 404 len: 111 microversion: 2.1 time: 0.064232 May 10 20:33:55.581005 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 418/863] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:55 2022] GET /compute/v2.1/servers/fe946939-f5a9-4b1a-abf1-0753f505d60f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:33:55.604829 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:55.612639 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fe9736d0-dcf5-481d-a381-7e0cc1c9d57d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1199 microversion: 2.1 time: 0.132475 May 10 20:33:55.613558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 446/864] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:55 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1199 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:56.409425 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:56.410403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:56.427491 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.428184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.430373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.433036 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.630306 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:56.630932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:56.644174 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.649962 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.650658 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:56.651158 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.651249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.666192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:56.668315 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:56.670996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a4b75c3d-3d42-4077-bdd1-32665cc8c10f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.267181 May 10 20:33:56.682076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 419/865] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:56 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:56.788915 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:56.790233 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:56.802925 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.803399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.804208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.804657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.834529 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] HTTP exception thrown: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.835451 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Request method failure captured: May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 HTTP/1.1 May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqxi7V7XQA-k3rei_g2ZjFTN-zC7UGE1zcdZWO1gtdINDX1p0LiJWapE1vvPb-f2n8rWegW6AZxma-oWwvjrIkxtj2002-kMYxpRAoRlwXAQxONMg_TY-1dGCqukZtbWqe0ireN0hujGIn6Dy4NWJr3WUnyb0SOWZGodMqtXIGDHO4 May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:56.843493 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/638a84064b2244e0b938b063e13cb944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_638a84064b2244e0b938b063e13cb944", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: e092796100394b63a7304abae7e25f7d May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.845127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '00f69eab-9bdc-4e34-a3ed-e7417bc13c95'} May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:56.846049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.847307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.848479 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Returning 404 to user: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:56.848479 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c3fd9b6d-bbdc-4944-8fa9-1565cc163854 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "DELETE /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 404 len: 111 microversion: 2.1 time: 0.059996 May 10 20:33:56.848479 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 420/866] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:33:56 2022] DELETE /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:56.850043 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-32e75e82-d76e-45ea-b6e7-295fbfd6c9dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.218315 May 10 20:33:56.851387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 447/867] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:56 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:56.864911 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:56.865815 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] [instance: 00f69eab-9bdc-4e34-a3ed-e7417bc13c95] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:56.872604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.873109 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.874919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:56.875371 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:56.897018 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] HTTP exception thrown: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Request method failure captured: May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 HTTP/1.1 May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesqxi7V7XQA-k3rei_g2ZjFTN-zC7UGE1zcdZWO1gtdINDX1p0LiJWapE1vvPb-f2n8rWegW6AZxma-oWwvjrIkxtj2002-kMYxpRAoRlwXAQxONMg_TY-1dGCqukZtbWqe0ireN0hujGIn6Dy4NWJr3WUnyb0SOWZGodMqtXIGDHO4 May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:33:56.899831 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/638a84064b2244e0b938b063e13cb944"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_638a84064b2244e0b938b063e13cb944", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/638a84064b2244e0b938b063e13cb944"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 638a84064b2244e0b938b063e13cb944 May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1949992121 May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: e092796100394b63a7304abae7e25f7d May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeTestJSON-1949992121-project May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.901418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '00f69eab-9bdc-4e34-a3ed-e7417bc13c95'} May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:33:56.902271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. May 10 20:33:56.904286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:33:56.906705 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] Returning 404 to user: Instance 00f69eab-9bdc-4e34-a3ed-e7417bc13c95 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:33:56.907741 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-80d954fd-5466-41f5-a952-124c81e44a64 tempest-AttachVolumeTestJSON-1949992121 tempest-AttachVolumeTestJSON-1949992121-project] 10.222.0.61 "GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95" status: 404 len: 111 microversion: 2.1 time: 0.057030 May 10 20:33:56.908774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 421/868] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:56 2022] GET /compute/v2.1/servers/00f69eab-9bdc-4e34-a3ed-e7417bc13c95 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:33:57.474283 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-0ac6011e-e283-45b0-9bb8-ca28fa1beeff req-8e4dd6cf-c38d-4a1e-a0a9-420649b7b641 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1365be-60d0-4cc7-b338-58257a75ab19", "tag": "ce64c984-b78b-4730-942e-62fd2c030058"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:33:57.487528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0ac6011e-e283-45b0-9bb8-ca28fa1beeff req-8e4dd6cf-c38d-4a1e-a0a9-420649b7b641 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:57.497498 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-0ac6011e-e283-45b0-9bb8-ca28fa1beeff req-8e4dd6cf-c38d-4a1e-a0a9-420649b7b641 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:57.546383 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-0ac6011e-e283-45b0-9bb8-ca28fa1beeff req-8e4dd6cf-c38d-4a1e-a0a9-420649b7b641 service nova] Creating event network-changed:ce64c984-b78b-4730-942e-62fd2c030058 for instance ee1365be-60d0-4cc7-b338-58257a75ab19 on hv-cinder-82880 May 10 20:33:57.560641 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-0ac6011e-e283-45b0-9bb8-ca28fa1beeff req-8e4dd6cf-c38d-4a1e-a0a9-420649b7b641 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090999 May 10 20:33:57.561291 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 448/869] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:33:57.689835 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:57.690516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:57.700836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:57.710557 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:57.711486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:57.712143 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:57.869616 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:57.876215 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:57.889129 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:57.889955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:57.891404 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:57.892254 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:58.145588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:58.155027 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:58.166388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:58.167889 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0a60c8a8-2d45-4319-bc5d-5090b2b70e7c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.482441 May 10 20:33:58.168929 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 422/870] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:57 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:33:58.249144 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:58.262416 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c5e5ccd4-c3c5-478f-bd5c-8e4963c2181c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.398557 May 10 20:33:58.278134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 449/871] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:57 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:33:59.192359 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:59.193616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:59.205820 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:59.207232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:59.208462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:59.210162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:59.282645 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:33:59.283270 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:33:59.295223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:59.304032 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:59.304922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:33:59.305533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:33:59.764618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:59.785217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fc97134a-27f3-4d53-8fae-bccedd708872 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.507167 May 10 20:33:59.789726 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 450/872] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:33:59 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:33:59.816582 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:59.828749 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:59.830985 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:33:59.832398 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-261ef908-ee62-4609-87f3-c4eaf00ed5df tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.644364 May 10 20:33:59.833016 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 423/873] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:33:59 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:00.811529 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:00.812960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:00.822730 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:00.824196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:00.824870 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:00.828217 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:00.850949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:00.852275 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:00.860988 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:00.862293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:00.867184 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:00.867872 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:01.173692 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:01.180993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6d9c246e-f2b3-4b37-9f75-32b4fd0c6f41 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.375218 May 10 20:34:01.181576 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 451/874] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:00 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:01.228192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:01.235898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:01.237421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:01.238572 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5a2fb5fd-9ce0-4baa-a373-ad12fa5f75b1 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1740 microversion: 2.20 time: 0.391824 May 10 20:34:01.239130 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 424/875] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:00 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:34:02.198315 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:02.198932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:02.206131 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:02.206601 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:02.207373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:02.208341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:02.260329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:02.262323 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:02.272020 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:02.273102 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:02.274201 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:02.274865 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:02.419788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:02.436047 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8a1d1cbb-976d-40f4-8ad0-94ee6de375ac tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.240358 May 10 20:34:02.445564 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 452/876] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:02 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:02.467351 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:02.475176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:02.476671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:02.477879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1e099073-dd37-4f0b-ad8d-0f38dc4f659e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1722 microversion: 2.20 time: 0.224019 May 10 20:34:02.478470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 425/877] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:02 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:34:03.453157 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:03.454472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:03.461286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:03.461755 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:03.462599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:03.463016 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:03.495838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:03.497419 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:03.504431 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:03.505019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:03.505916 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:03.506360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:03.652609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:03.661085 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-909e5194-af33-436b-9891-5dd697559f5d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.212490 May 10 20:34:03.661832 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 453/878] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:03 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:03.691282 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:03.701141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:03.708203 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:03.709449 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-47861f07-0a8b-4bcf-86e6-610ee0e295b7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1722 microversion: 2.20 time: 0.217895 May 10 20:34:03.710014 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 426/879] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:03 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:34:04.679298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:04.679932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:04.686595 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:04.686994 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:04.687979 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:04.688838 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:04.730333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:04.730878 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:04.739483 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:04.739940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:04.740751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:04.741221 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:04.893902 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:04.901986 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8fcacd9e-e513-47c7-9151-a77cefe6f985 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.227488 May 10 20:34:04.912018 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 454/880] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:04 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:04.924577 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:04.932933 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:04.934524 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:04.935706 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f15e5ec7-54d3-43ac-ba42-54681cf9d455 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1665 microversion: 2.20 time: 0.209184 May 10 20:34:04.936270 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 427/881] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:04 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1665 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:04.953322 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6c796290-f5c7-4901-9504-9bcf0e4f1b8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8acfd98f-ec2a-49f5-8060-e6a660337fed"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:04.954275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6c796290-f5c7-4901-9504-9bcf0e4f1b8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:04.960321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6c796290-f5c7-4901-9504-9bcf0e4f1b8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:04.960777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6c796290-f5c7-4901-9504-9bcf0e4f1b8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:04.961581 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6c796290-f5c7-4901-9504-9bcf0e4f1b8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:04.962023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6c796290-f5c7-4901-9504-9bcf0e4f1b8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.230823 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6c796290-f5c7-4901-9504-9bcf0e4f1b8a tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.281552 May 10 20:34:05.231429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 455/882] 10.222.0.61 () {62 vars in 1363 bytes} [Tue May 10 20:34:04 2022] POST /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-volume_attachments => generated 188 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 20:34:05.274213 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-bfb73557-8215-45d1-8723-a32d74a5033a req-60a24e68-2f43-4325-8f93-1dfea9d95ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd776b6-60d4-4205-ac05-bfdb5b92c4b9", "name": "network-vif-unplugged", "status": "completed", "tag": "f9a5ff83-f76c-42b5-8831-862bc9d49d17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:05.289613 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-bfb73557-8215-45d1-8723-a32d74a5033a req-60a24e68-2f43-4325-8f93-1dfea9d95ef5 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.290065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-bfb73557-8215-45d1-8723-a32d74a5033a req-60a24e68-2f43-4325-8f93-1dfea9d95ef5 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.314207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.compute.server_external_events [req-bfb73557-8215-45d1-8723-a32d74a5033a req-60a24e68-2f43-4325-8f93-1dfea9d95ef5 service nova] Unable to find a host for instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9. Dropping event network-vif-unplugged {{(pid=117260) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 20:34:05.315462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-bfb73557-8215-45d1-8723-a32d74a5033a req-60a24e68-2f43-4325-8f93-1dfea9d95ef5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.044769 May 10 20:34:05.316254 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 428/883] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 20:34:05.358542 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2d12a0bc-4d30-4ec2-91f6-622ed53f1cdb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:05.359045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2d12a0bc-4d30-4ec2-91f6-622ed53f1cdb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:05.364907 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2d12a0bc-4d30-4ec2-91f6-622ed53f1cdb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.365403 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2d12a0bc-4d30-4ec2-91f6-622ed53f1cdb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.366188 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2d12a0bc-4d30-4ec2-91f6-622ed53f1cdb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.366634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2d12a0bc-4d30-4ec2-91f6-622ed53f1cdb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.597651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2d12a0bc-4d30-4ec2-91f6-622ed53f1cdb tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-volume_attachments/8acfd98f-ec2a-49f5-8060-e6a660337fed" status: 202 len: 0 microversion: 2.20 time: 0.243494 May 10 20:34:05.598286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 456/884] 10.222.0.61 () {60 vars in 1456 bytes} [Tue May 10 20:34:05 2022] DELETE /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-volume_attachments/8acfd98f-ec2a-49f5-8060-e6a660337fed => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 20:34:05.653795 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-07e1a042-994f-4b3d-80a3-03c0c0eff38e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:05.654366 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-07e1a042-994f-4b3d-80a3-03c0c0eff38e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:05.660399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-07e1a042-994f-4b3d-80a3-03c0c0eff38e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.660858 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-07e1a042-994f-4b3d-80a3-03c0c0eff38e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.661671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-07e1a042-994f-4b3d-80a3-03c0c0eff38e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.662111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-07e1a042-994f-4b3d-80a3-03c0c0eff38e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.890016 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-07e1a042-994f-4b3d-80a3-03c0c0eff38e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "POST /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/action" status: 202 len: 0 microversion: 2.20 time: 0.240586 May 10 20:34:05.893994 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 429/885] 10.222.0.61 () {62 vars in 1318 bytes} [Tue May 10 20:34:05 2022] POST /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 20:34:05.898893 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:05.900079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:05.916911 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.917712 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.918913 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.919441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.920605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:05.921495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:05.928863 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.929304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:05.930089 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:05.930537 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:06.162522 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:06.172226 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-113a52be-6a05-4bc5-95bb-87894c035bfc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.255815 May 10 20:34:06.185363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 430/886] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:05 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:34:06.198079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:06.214397 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:06.217511 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:06.219035 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ce19c88f-c11a-409b-ab30-aab7cd140e5d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1673 microversion: 2.20 time: 0.323960 May 10 20:34:06.230218 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 457/887] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:05 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1673 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:07.193519 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:07.195337 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:07.205062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:07.205480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:07.206466 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:07.206915 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:07.242881 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:07.244544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:07.254269 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:07.254955 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:07.256160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:07.257247 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:07.449082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:07.469269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fe364ccb-9ed5-45fd-a749-489a93147f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.275229 May 10 20:34:07.470563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 431/888] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:07 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:07.483927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-aec21ff5-ecf2-4ea8-afb4-db445bc8e9f0 req-63e227ac-ccfc-494f-a01f-07acaef96b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1365be-60d0-4cc7-b338-58257a75ab19", "name": "network-vif-plugged", "status": "completed", "tag": "ce64c984-b78b-4730-942e-62fd2c030058"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:07.494544 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-aec21ff5-ecf2-4ea8-afb4-db445bc8e9f0 req-63e227ac-ccfc-494f-a01f-07acaef96b68 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:07.495355 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-aec21ff5-ecf2-4ea8-afb4-db445bc8e9f0 req-63e227ac-ccfc-494f-a01f-07acaef96b68 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:07.508483 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-aec21ff5-ecf2-4ea8-afb4-db445bc8e9f0 req-63e227ac-ccfc-494f-a01f-07acaef96b68 service nova] Creating event network-vif-plugged:ce64c984-b78b-4730-942e-62fd2c030058 for instance ee1365be-60d0-4cc7-b338-58257a75ab19 on hv-cinder-82880 May 10 20:34:07.516483 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:07.519149 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-aec21ff5-ecf2-4ea8-afb4-db445bc8e9f0 req-63e227ac-ccfc-494f-a01f-07acaef96b68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044579 May 10 20:34:07.520024 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 432/889] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:34:07.527448 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:07.529004 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:07.530839 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bc72ac1f-6c9a-4d21-b22c-682b31a5ef67 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.297640 May 10 20:34:07.531980 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 458/890] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:07 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:08.489002 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:08.490502 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:08.500781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:08.503077 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:08.506369 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:08.507168 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:08.550846 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:08.552287 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:08.561313 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:08.562275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:08.567574 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:08.568266 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:08.858808 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:08.870431 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:08.876199 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:08.878077 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-789ef1e2-2bf3-404b-b918-faf0cdc69c31 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.331506 May 10 20:34:08.894999 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 459/891] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:08 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:08.945096 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:08.954510 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-deb74e78-974a-452d-8b77-899bb37508d7 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.470906 May 10 20:34:08.955697 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 433/892] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:08 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:09.902637 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:09.903662 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:09.912886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:09.917025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:09.917025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:09.917025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:09.977412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:09.984571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:09.992410 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:09.993269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:10.003717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:10.004598 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:10.197835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:10.210300 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:10.213693 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:10.215928 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-693f4894-e4f1-41eb-98c1-8d69b77e558d tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.319355 May 10 20:34:10.217920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 460/893] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:09 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:10.232775 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:10.245104 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-835855a9-5e09-418d-96ba-aabfcad59ef3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.271238 May 10 20:34:10.246401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 434/894] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:09 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:11.236816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:11.237569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:11.251050 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:11.251715 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:11.252506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:11.253219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:11.263870 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:11.265195 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:11.274411 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:11.275150 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:11.276128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:11.276728 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:11.527650 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:11.540427 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:11.551460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:11.551605 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:11.553758 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6a5b15d3-eeca-468f-b674-3df3c403ff94 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.321532 May 10 20:34:11.554746 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 461/895] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:11 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:11.571922 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e53ba830-a494-4631-85ec-fa6fe2edd046 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.313290 May 10 20:34:11.573110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 435/896] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:11 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:12.576302 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:12.577846 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:12.589242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:12.589457 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:12.589919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:12.590572 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:12.592194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:12.592816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:12.596332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:12.596789 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:12.597602 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:12.598223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:12.864293 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:12.877815 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:12.895584 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:12.898099 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-26465b19-1cb8-4bab-8af2-a9e71dedf34f tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.326925 May 10 20:34:12.902479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 462/897] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:12 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:12.912442 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:12.921845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4f98e0ab-2690-4ed6-817e-ecb8edd6f3c8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.336342 May 10 20:34:12.925115 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 436/898] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:12 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:34:13.917437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:13.918178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:13.926578 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:13.927045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:13.927849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:13.928298 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:13.940918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:13.941562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:13.958293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:13.958901 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:13.959855 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:13.960414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:14.200223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:14.211858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:14.214350 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:14.215774 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:14.216356 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-157d6f7f-369d-4f7f-b766-3551a3c39321 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.302428 May 10 20:34:14.217685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 463/899] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:13 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:34:14.224380 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8b457338-7568-404a-9cde-d3c821843bc4 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.287162 May 10 20:34:14.225487 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 437/900] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:13 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:15.236229 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:15.236856 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:15.241182 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:15.241802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:15.243899 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:15.244347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:15.245183 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:15.245620 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:15.248811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:15.249661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:15.250444 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:15.251050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:15.458381 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:15.475239 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-975816e2-2ec1-4753-80d6-1f382c095029 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.237996 May 10 20:34:15.476229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 438/901] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:15 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:34:15.485588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:15.494123 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:15.495885 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:15.497867 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8237406a-3b0d-42fb-b287-e4806350f22c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.266716 May 10 20:34:15.498992 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 464/902] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:15 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:16.492846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:16.493485 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:16.500002 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:16.500459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:16.501272 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:16.501731 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:16.516921 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:16.518568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:16.524810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:16.525362 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:16.526203 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:16.526708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:16.692004 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:16.699247 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3c2ff46c-4d40-458b-be54-f3091086b3fc tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1265 microversion: 2.1 time: 0.210405 May 10 20:34:16.700591 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 439/903] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:16 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:16.714755 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:16.722503 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:16.724006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:16.725191 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3eb8ec4d-f059-44bf-a384-4f8911ad72e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.212219 May 10 20:34:16.725787 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 465/904] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:16 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 20:34:17.717708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:17.718558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:17.738736 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:17.739198 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:17.740738 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:17.741202 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:17.744961 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:17.745652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:17.753124 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:17.753587 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:17.754568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:17.754866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:17.945898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:17.953986 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-967d904e-6065-444e-88ae-c221835f17e0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1453 microversion: 2.1 time: 0.240949 May 10 20:34:17.954573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 440/905] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:17 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1453 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:34:17.959775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:17.968809 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:17.970574 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:17.971260 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:17.971909 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:17.972358 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-960eb01f-94d8-48ee-bd2a-502c77dc8191 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.232419 May 10 20:34:17.973284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 466/906] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:17 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:17.985882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:17.985882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:17.986687 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:17.987156 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:18.119234 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:18.127523 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0737e862-621f-4863-acdf-f7970be7e964 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1453 microversion: 2.1 time: 0.160151 May 10 20:34:18.128191 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 441/907] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:34:17 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:34:18.990447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:18.992275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:19.000461 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:19.000928 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:19.001756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:19.002393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:19.144547 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:19.156419 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:19.157991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:19.159294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1e30ae0b-dc49-4c26-ba72-f698e0fc5376 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.172702 May 10 20:34:19.160040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 467/908] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:18 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:20.060080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-ab3ae6f9-1913-4cd7-b3a1-d0f9aae68265 req-a67e8890-831e-4cc1-bb9c-9018cf49c07f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1365be-60d0-4cc7-b338-58257a75ab19", "tag": "ce64c984-b78b-4730-942e-62fd2c030058"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:20.070719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ab3ae6f9-1913-4cd7-b3a1-d0f9aae68265 req-a67e8890-831e-4cc1-bb9c-9018cf49c07f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:20.071439 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-ab3ae6f9-1913-4cd7-b3a1-d0f9aae68265 req-a67e8890-831e-4cc1-bb9c-9018cf49c07f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:20.083753 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-ab3ae6f9-1913-4cd7-b3a1-d0f9aae68265 req-a67e8890-831e-4cc1-bb9c-9018cf49c07f service nova] Creating event network-changed:ce64c984-b78b-4730-942e-62fd2c030058 for instance ee1365be-60d0-4cc7-b338-58257a75ab19 on hv-cinder-82880 May 10 20:34:20.089683 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-ab3ae6f9-1913-4cd7-b3a1-d0f9aae68265 req-a67e8890-831e-4cc1-bb9c-9018cf49c07f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033600 May 10 20:34:20.091116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 442/909] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:34:20.176809 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:20.178039 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:20.185054 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:20.198086 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:20.199206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:20.199686 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:20.350878 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:20.359156 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:20.360640 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:20.361823 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-92099a96-35d5-41a9-a94e-6c0788c7be03 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.188867 May 10 20:34:20.362378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 468/910] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:20 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:21.380403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:21.381123 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:21.387969 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:21.388444 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:21.389264 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:21.389704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:21.515309 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:21.523262 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:21.524750 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:21.525927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c5b7d5ce-b3d4-45a3-bd1d-e87b03a09295 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.150172 May 10 20:34:21.526503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 443/911] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:21 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:22.544324 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:22.545675 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:22.554452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:22.554974 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:22.555840 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:22.556351 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:22.708746 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:22.716796 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:22.718333 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:22.719503 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e537c36b-fda9-4b06-abeb-decc7e004afc tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.179682 May 10 20:34:22.720312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 469/912] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:22 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:22.855773 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-e83f1646-bf6f-48e8-86a3-110fa3815702 req-824a4987-a268-4f0f-8456-58fa46cdcec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd776b6-60d4-4205-ac05-bfdb5b92c4b9", "name": "network-vif-plugged", "status": "completed", "tag": "f9a5ff83-f76c-42b5-8831-862bc9d49d17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:34:22.864396 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-e83f1646-bf6f-48e8-86a3-110fa3815702 req-824a4987-a268-4f0f-8456-58fa46cdcec7 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:22.864709 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-e83f1646-bf6f-48e8-86a3-110fa3815702 req-824a4987-a268-4f0f-8456-58fa46cdcec7 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:23.044637 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-e83f1646-bf6f-48e8-86a3-110fa3815702 req-824a4987-a268-4f0f-8456-58fa46cdcec7 service nova] Creating event network-vif-plugged:f9a5ff83-f76c-42b5-8831-862bc9d49d17 for instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 on hv-cinder-82880 May 10 20:34:23.049666 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-e83f1646-bf6f-48e8-86a3-110fa3815702 req-824a4987-a268-4f0f-8456-58fa46cdcec7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197573 May 10 20:34:23.050267 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 444/913] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:34:23.737810 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:23.738453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:23.744245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:23.744704 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:23.745508 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:23.746435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:23.883971 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:23.892638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:23.894677 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:23.895916 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f1c5a29d-d6a1-4336-b604-78ac6b072ae7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.162171 May 10 20:34:23.896472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 470/914] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:23 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:24.915906 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:24.916741 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:24.923730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:24.924463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:24.925386 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:24.925932 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:25.066791 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:25.075794 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:25.077437 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:25.078866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-40bbaa3e-e211-4a0a-9090-90589bf1c2b4 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1731 microversion: 2.20 time: 0.167686 May 10 20:34:25.079465 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 445/915] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:24 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:34:26.097360 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:34:26.097969 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:34:26.104326 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:26.104778 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:26.105588 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:34:26.106030 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:34:26.233707 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:26.241444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:26.242874 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:34:26.244028 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-6b8abea8-2796-4097-98a0-a1d1a23749c2 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1718 microversion: 2.20 time: 0.150692 May 10 20:34:26.244586 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 471/916] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:34:26 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1718 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:35:14.119504 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8f92433e-c24a-4170-a544-0ab6201c12e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:14.120495 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8f92433e-c24a-4170-a544-0ab6201c12e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:14.127354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8f92433e-c24a-4170-a544-0ab6201c12e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:14.128277 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8f92433e-c24a-4170-a544-0ab6201c12e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:14.129374 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8f92433e-c24a-4170-a544-0ab6201c12e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:14.130086 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8f92433e-c24a-4170-a544-0ab6201c12e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:14.174835 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8f92433e-c24a-4170-a544-0ab6201c12e7 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059383 May 10 20:35:14.181338 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 446/917] 10.222.0.61 () {60 vars in 1342 bytes} [Tue May 10 20:35:14 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:14.244108 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:14.245474 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:14.252753 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:14.253508 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:14.254475 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:14.255080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:14.284238 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:35:14.382834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-407012b5-6f1b-47d9-9b52-fab5ec4e8c66 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 204 len: 0 microversion: 2.20 time: 0.142362 May 10 20:35:14.387909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 472/918] 10.222.0.61 () {60 vars in 1279 bytes} [Tue May 10 20:35:14 2022] DELETE /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:35:14.396222 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:14.396982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:14.403422 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:14.403984 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:14.404843 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:14.405431 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:14.548548 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:14.557633 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:14.559263 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:14.561274 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-72a667e9-9e9d-40cb-b75a-e6414814709c tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.170597 May 10 20:35:14.562055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 447/919] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:35:14 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:35:15.580611 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:15.581719 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:15.590109 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:15.590900 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:15.592101 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:15.592775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:15.750927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:15.762531 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:15.764455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:15.766147 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4dccaa08-7dd4-4490-91e6-96becb4cb7f9 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1724 microversion: 2.20 time: 0.189859 May 10 20:35:15.767532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 473/920] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:35:15 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:35:16.786777 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:16.787394 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:16.795075 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:16.795524 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:16.796307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:16.796740 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:16.865969 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:16.877000 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:16.878723 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '36c95ddbd4384bb3a63d02698684e29a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89cf2816f8884e679e6c7e4c3d98f348', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:16.880297 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-527a446a-bc37-4a33-bc12-517e592bcc62 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 200 len: 1656 microversion: 2.20 time: 0.099694 May 10 20:35:16.881445 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 448/921] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:35:16 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 1656 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 20:35:17.394766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-f2336146-52de-4170-9157-0545ab86effc req-6e529abc-89eb-466b-9309-43b3f388f8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efd776b6-60d4-4205-ac05-bfdb5b92c4b9", "name": "network-vif-deleted", "tag": "f9a5ff83-f76c-42b5-8831-862bc9d49d17"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:17.413066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-f2336146-52de-4170-9157-0545ab86effc req-6e529abc-89eb-466b-9309-43b3f388f8a0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:17.413459 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-f2336146-52de-4170-9157-0545ab86effc req-6e529abc-89eb-466b-9309-43b3f388f8a0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:17.431135 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-f2336146-52de-4170-9157-0545ab86effc req-6e529abc-89eb-466b-9309-43b3f388f8a0 service nova] Creating event network-vif-deleted:f9a5ff83-f76c-42b5-8831-862bc9d49d17 for instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 on hv-cinder-82880 May 10 20:35:17.436513 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-f2336146-52de-4170-9157-0545ab86effc req-6e529abc-89eb-466b-9309-43b3f388f8a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046119 May 10 20:35:17.437770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 474/922] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:17.900141 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:17.900771 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:17.915615 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:17.916063 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:17.916867 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:17.922068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:17.939065 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] HTTP exception thrown: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Request method failure captured: May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 HTTP/1.1 May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesq0li_3yBP2XNiIv5pOqBP3CGe_cxdHkzIvwpAAihKWqTJknN-z_q4GuzNk06GF_uQ6HzOMRLklhy-J8XgPn_cSFvzxuE7ObcYb8MMNw3Dy79yxLcJ5cVZzZzBEx-a1nHisZJA07xFjNUtN78CS54BbWtS3p6T8UklMa3nm_EnvMoI May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:35:17.940940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_89cf2816f8884e679e6c7e4c3d98f348", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 36c95ddbd4384bb3a63d02698684e29a May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:17.942726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'efd776b6-60d4-4205-ac05-bfdb5b92c4b9'} May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:35:17.943672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:17.945215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:17.948059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Returning 404 to user: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:35:17.949231 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3422426d-bd1c-4b11-82b3-fc0d726edf11 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 404 len: 111 microversion: 2.20 time: 0.053354 May 10 20:35:17.952714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 449/923] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:35:17 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:35:17.963421 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-416c8814-49ba-4da1-bf87-d0e56263bcaf tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '.version_select at 0x7fb2732bb5e0>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:17.989946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-416c8814-49ba-4da1-bf87-d0e56263bcaf tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-354853328" status: 204 len: 0 microversion: 2.20 time: 0.032073 May 10 20:35:17.995474 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 475/924] 10.222.0.61 () {60 vars in 1258 bytes} [Tue May 10 20:35:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-354853328 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 20:35:19.922142 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:19.922767 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:19.929725 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:19.930403 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:19.931288 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:19.931829 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:19.946385 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] HTTP exception thrown: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Request method failure captured: May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 HTTP/1.1 May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesq0li_3yBP2XNiIv5pOqBP3CGe_cxdHkzIvwpAAihKWqTJknN-z_q4GuzNk06GF_uQ6HzOMRLklhy-J8XgPn_cSFvzxuE7ObcYb8MMNw3Dy79yxLcJ5cVZzZzBEx-a1nHisZJA07xFjNUtN78CS54BbWtS3p6T8UklMa3nm_EnvMoI May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:35:19.947952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_89cf2816f8884e679e6c7e4c3d98f348", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 36c95ddbd4384bb3a63d02698684e29a May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.949636 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'efd776b6-60d4-4205-ac05-bfdb5b92c4b9'} May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:35:19.952001 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.953494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:19.955604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Returning 404 to user: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:35:19.955604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bf6e721d-25a0-4275-b79d-2f329b0a9f7e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 404 len: 111 microversion: 2.20 time: 0.035331 May 10 20:35:19.955604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 450/925] 10.222.0.61 () {60 vars in 1279 bytes} [Tue May 10 20:35:19 2022] DELETE /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:35:19.961558 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:19.962367 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: efd776b6-60d4-4205-ac05-bfdb5b92c4b9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:19.974671 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:19.975194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:19.976321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:19.976898 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:19.994024 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] HTTP exception thrown: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Request method failure captured: May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 HTTP/1.1 May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesq0li_3yBP2XNiIv5pOqBP3CGe_cxdHkzIvwpAAihKWqTJknN-z_q4GuzNk06GF_uQ6HzOMRLklhy-J8XgPn_cSFvzxuE7ObcYb8MMNw3Dy79yxLcJ5cVZzZzBEx-a1nHisZJA07xFjNUtN78CS54BbWtS3p6T8UklMa3nm_EnvMoI May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:35:19.995552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_89cf2816f8884e679e6c7e4c3d98f348", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 36c95ddbd4384bb3a63d02698684e29a May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.997320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'efd776b6-60d4-4205-ac05-bfdb5b92c4b9'} May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:35:19.998228 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. May 10 20:35:19.999528 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:20.003282 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Returning 404 to user: Instance efd776b6-60d4-4205-ac05-bfdb5b92c4b9 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:35:20.004403 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8166d2b5-5b7e-4421-bf45-4b1983230888 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9" status: 404 len: 111 microversion: 2.20 time: 0.047289 May 10 20:35:20.005399 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 476/926] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:35:19 2022] GET /compute/v2.1/servers/efd776b6-60d4-4205-ac05-bfdb5b92c4b9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 20:35:21.200891 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:21.201472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:21.208811 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:21.209290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:21.211558 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:21.212165 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:21.260519 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] HTTP exception thrown: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Request method failure captured: May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd HTTP/1.1 May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesq0li_3yBP2XNiIv5pOqBP3CGe_cxdHkzIvwpAAihKWqTJknN-z_q4GuzNk06GF_uQ6HzOMRLklhy-J8XgPn_cSFvzxuE7ObcYb8MMNw3Dy79yxLcJ5cVZzZzBEx-a1nHisZJA07xFjNUtN78CS54BbWtS3p6T8UklMa3nm_EnvMoI May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:35:21.262407 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_89cf2816f8884e679e6c7e4c3d98f348", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 36c95ddbd4384bb3a63d02698684e29a May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.264062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'daa24eb7-cd9f-4ca7-bad7-5c275879fecd'} May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:35:21.264946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.266470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:35:21.270369 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Returning 404 to user: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:35:21.271453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1bf1beb1-a918-4e46-bbc1-cc263006084e tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "DELETE /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 404 len: 111 microversion: 2.20 time: 0.076376 May 10 20:35:21.272521 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 451/927] 10.222.0.61 () {60 vars in 1279 bytes} [Tue May 10 20:35:21 2022] DELETE /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 20:35:21.282602 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:21.283879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] [instance: daa24eb7-cd9f-4ca7-bad7-5c275879fecd] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:21.291951 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:21.292653 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:21.293737 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:21.295066 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:21.335683 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] HTTP exception thrown: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Request method failure captured: May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd HTTP/1.1 May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesq0li_3yBP2XNiIv5pOqBP3CGe_cxdHkzIvwpAAihKWqTJknN-z_q4GuzNk06GF_uQ6HzOMRLklhy-J8XgPn_cSFvzxuE7ObcYb8MMNw3Dy79yxLcJ5cVZzZzBEx-a1nHisZJA07xFjNUtN78CS54BbWtS3p6T8UklMa3nm_EnvMoI May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Openstack-Nova-Api-Version: 2.20 May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:35:21.339858 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_89cf2816f8884e679e6c7e4c3d98f348", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/89cf2816f8884e679e6c7e4c3d98f348"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 89cf2816f8884e679e6c7e4c3d98f348 May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-73573165 May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 36c95ddbd4384bb3a63d02698684e29a May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeShelveTestJSON-73573165-project May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.342104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'daa24eb7-cd9f-4ca7-bad7-5c275879fecd'} May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:35:21.342857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. May 10 20:35:21.344036 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:35:21.345971 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] Returning 404 to user: Instance daa24eb7-cd9f-4ca7-bad7-5c275879fecd could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:35:21.345971 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7c1f9c94-6fbe-4dde-897c-1d285a0fea24 tempest-AttachVolumeShelveTestJSON-73573165 tempest-AttachVolumeShelveTestJSON-73573165-project] 10.222.0.61 "GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd" status: 404 len: 111 microversion: 2.20 time: 0.067119 May 10 20:35:21.348380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 477/928] 10.222.0.61 () {60 vars in 1276 bytes} [Tue May 10 20:35:21 2022] GET /compute/v2.1/servers/daa24eb7-cd9f-4ca7-bad7-5c275879fecd => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 20:35:22.946354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-95dd4222-9523-41f2-8a01-d6bb80a72005 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Action: 'create', calling method: .version_select at 0x7fb278134f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-211257665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAT0tPiUVdlD/ejKAB3upCx/YVDXeU6HndenP7JQFEW+oEVlWw36A54c3w+KtSgfANcf4BXbfSxd08fQX8/JW3BPiNFyeyK7AyPGIaGzFvUjX9RjKeNgtDMvKWTqfbEsTA=="}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:22.973802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-95dd4222-9523-41f2-8a01-d6bb80a72005 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Getting quotas for project 61379b54bfc341878955a07870c5fda4. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:35:22.984931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-95dd4222-9523-41f2-8a01-d6bb80a72005 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Getting quotas for user 676ded85a5b545939d26ddc630d1fac3 and project 61379b54bfc341878955a07870c5fda4. Resources: {'key_pairs'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:35:23.046704 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-95dd4222-9523-41f2-8a01-d6bb80a72005 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.393761 May 10 20:35:23.048011 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 452/929] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:35:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:31.849661 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-25224065-98ef-4e28-90d0-42946fabf0e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: .version_select at 0x7fb27325bca0>, body: {"keypair": {"name": "tempest-keypair-316995153", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLlLN7lReP95MXoPeFC3V/kAT8bHTvWQz6YDLZaiyl0tYE8AB0yXFZ8KDGwywocUgnWU+FZpKlgJYU9M3EPIRQReVUy+Uw3H4po+aOctmSUKdhrT8OR8ZfCqhWKeTEcaw=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:31.867740 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-25224065-98ef-4e28-90d0-42946fabf0e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:35:31.871454 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-25224065-98ef-4e28-90d0-42946fabf0e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:35:31.898643 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-25224065-98ef-4e28-90d0-42946fabf0e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190165 May 10 20:35:31.905212 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 478/930] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:35:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:33.254398 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2003896249", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86bfbdf-9b8b-4914-a508-1afa24268f93"}], "security_groups": [{"name": "tempest-securitygroup--501080985"}], "key_name": "tempest-keypair-316995153", "user_data": "}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:33.391402 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] validate_networks() for [('e86bfbdf-9b8b-4914-a508-1afa24268f93', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:35:33.855475 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:35:33.856619 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:35:33.857531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:35:33.859317 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:35:33.859858 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:35:33.868904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:33.869492 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:33.870362 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:33.870868 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:33.887309 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:35:33.891813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:35:33.904293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:35:33.906765 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:35:33.957499 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bb6beac8-781b-41cd-beec-a6218c5cab49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.707594 May 10 20:35:33.958492 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 453/931] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:35:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:35:33.969480 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-424f07a8-a017-4dda-8326-491dbf28dbcc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:33.970743 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-424f07a8-a017-4dda-8326-491dbf28dbcc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:34.031345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-424f07a8-a017-4dda-8326-491dbf28dbcc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:34.042247 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-424f07a8-a017-4dda-8326-491dbf28dbcc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1241 microversion: 2.1 time: 0.077627 May 10 20:35:34.042834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 479/932] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:33 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:35.061401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:35.062959 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:35.073475 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:35.074901 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:35.075907 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:35.076392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:35.146436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:35.155510 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8af72aaf-6a5d-48b8-854a-3bd9d5eb7eed tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1301 microversion: 2.1 time: 0.099451 May 10 20:35:35.165222 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 454/933] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:35 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1301 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:36.172819 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:36.173462 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:36.180013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:36.180551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:36.181373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:36.181822 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:36.314005 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:36.322905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f2555e0f-da07-403f-92bf-4890405ee7eb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1366 microversion: 2.1 time: 0.154550 May 10 20:35:36.332469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 480/934] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:36 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:36.558446 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-b860db8e-65a3-4c80-ab04-ae751a875928 req-4b7499be-60ee-4030-8e05-5c9bf9d4c10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f81a471-e87d-4336-aa77-0d7e92083006", "tag": "9e2b91ca-1948-41ee-bd5e-aaf850ff56e1"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:36.568802 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-b860db8e-65a3-4c80-ab04-ae751a875928 req-4b7499be-60ee-4030-8e05-5c9bf9d4c10c service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:36.569125 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-b860db8e-65a3-4c80-ab04-ae751a875928 req-4b7499be-60ee-4030-8e05-5c9bf9d4c10c service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:36.595488 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-b860db8e-65a3-4c80-ab04-ae751a875928 req-4b7499be-60ee-4030-8e05-5c9bf9d4c10c service nova] Creating event network-changed:9e2b91ca-1948-41ee-bd5e-aaf850ff56e1 for instance 9f81a471-e87d-4336-aa77-0d7e92083006 on hv-cinder-82880 May 10 20:35:36.601207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-b860db8e-65a3-4c80-ab04-ae751a875928 req-4b7499be-60ee-4030-8e05-5c9bf9d4c10c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046894 May 10 20:35:36.601806 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 455/935] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:37.339986 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:37.341569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:37.347921 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:37.348367 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:37.349187 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:37.349620 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:37.473223 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:37.480500 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0b921d86-6d92-4b58-bd4b-bba5aa42e189 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1366 microversion: 2.1 time: 0.144421 May 10 20:35:37.481140 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 481/936] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:37 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:38.498538 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:38.499239 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:38.505408 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:38.505807 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:38.506584 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:38.507028 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:38.630656 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:38.638435 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-53f72a3a-f274-495d-898b-8a029878580e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1366 microversion: 2.1 time: 0.145056 May 10 20:35:38.638996 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 456/937] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:38 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:39.655954 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:39.656574 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:39.662940 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:39.663400 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:39.664170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:39.664610 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:39.794274 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:39.801484 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-9de86354-61a7-4a62-adf2-379a9cc3426e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1366 microversion: 2.1 time: 0.150024 May 10 20:35:39.802045 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 482/938] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:39 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:39.905383 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-392670619", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-211257665", "security_groups": [{"name": "tempest-secgroup-smoke-1817153175"}], "networks": [{"uuid": "bf2a6b0c-a1e6-4cda-adf9-908bec5507fb"}], "block_device_mapping_v2": [{"uuid": "ff7dbfc0-e34c-4a36-86bf-c01f0eaa18cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:40.015537 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] validate_networks() for [('bf2a6b0c-a1e6-4cda-adf9-908bec5507fb', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:35:40.370903 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:35:40.371333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:35:40.371812 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:35:40.372224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:35:40.372635 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:35:40.381216 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:40.381667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:40.382478 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:40.382918 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:40.399616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Getting quotas for project 61379b54bfc341878955a07870c5fda4. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:35:40.403506 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Getting quotas for user 676ded85a5b545939d26ddc630d1fac3 and project 61379b54bfc341878955a07870c5fda4. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:35:40.457866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:35:40.460068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff7dbfc0-e34c-4a36-86bf-c01f0eaa18cf',volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:35:40.584864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3be3c1db-63bb-4eec-abc9-ad408dfcf12d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.683321 May 10 20:35:40.585535 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 457/939] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:35:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:35:40.595486 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-183b9b83-c097-4df7-96cb-3716fe5f289f tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:40.596106 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-183b9b83-c097-4df7-96cb-3716fe5f289f tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:40.648441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-183b9b83-c097-4df7-96cb-3716fe5f289f tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:40.656162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-183b9b83-c097-4df7-96cb-3716fe5f289f tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1087 microversion: 2.1 time: 0.064466 May 10 20:35:40.656803 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 483/940] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:40 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:40.818978 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:40.819421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:40.825882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:40.826332 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:40.827116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:40.827540 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:40.959965 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:40.969755 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-aa0c3c43-0108-4663-90fb-62c381e973c2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1366 microversion: 2.1 time: 0.154860 May 10 20:35:40.970525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 458/941] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:40 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:41.292331 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-463b3c58-e5f4-4af4-bbcc-a27bba73190a req-9d75eab1-8804-46f2-ae81-b8453fbe49a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f81a471-e87d-4336-aa77-0d7e92083006", "name": "network-vif-plugged", "status": "completed", "tag": "9e2b91ca-1948-41ee-bd5e-aaf850ff56e1"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:41.302059 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-463b3c58-e5f4-4af4-bbcc-a27bba73190a req-9d75eab1-8804-46f2-ae81-b8453fbe49a6 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:41.302714 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-463b3c58-e5f4-4af4-bbcc-a27bba73190a req-9d75eab1-8804-46f2-ae81-b8453fbe49a6 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:41.313605 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-463b3c58-e5f4-4af4-bbcc-a27bba73190a req-9d75eab1-8804-46f2-ae81-b8453fbe49a6 service nova] Creating event network-vif-plugged:9e2b91ca-1948-41ee-bd5e-aaf850ff56e1 for instance 9f81a471-e87d-4336-aa77-0d7e92083006 on hv-cinder-82880 May 10 20:35:41.318552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-463b3c58-e5f4-4af4-bbcc-a27bba73190a req-9d75eab1-8804-46f2-ae81-b8453fbe49a6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029987 May 10 20:35:41.319143 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 484/942] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:41.673462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:41.674167 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:41.680538 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:41.680936 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:41.681809 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:41.682327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:41.754803 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:41.762038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-508ab45d-0631-4c63-ab76-9bb9d22fbac4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1203 microversion: 2.1 time: 0.093146 May 10 20:35:41.762585 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 459/943] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:41 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1203 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:41.991831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:41.992607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:42.000262 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:42.000720 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:42.001557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:42.001997 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:42.147161 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:42.155133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-89fbc1e1-a2e6-40d1-948c-dafbfc8dbb75 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1366 microversion: 2.1 time: 0.171048 May 10 20:35:42.155702 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 485/944] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:41 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:42.779546 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:42.780137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:42.786262 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:42.786836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:42.787516 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:42.787956 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:42.925286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:42.932572 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-257fdd70-be92-4410-83cd-c93e6d449fd4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.157291 May 10 20:35:42.933200 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 460/945] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:42 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:43.087708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-d569a19b-1cbc-41f3-afed-5a72a924692b req-fc0969f7-9253-4f7b-a4d4-e223ba70eedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc43bb45-4300-4d9e-81e8-3ac1dfc77246", "tag": "33a5e6ed-c63a-4e5f-a910-096813ddde2b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:43.104664 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-d569a19b-1cbc-41f3-afed-5a72a924692b req-fc0969f7-9253-4f7b-a4d4-e223ba70eedf service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.105154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-d569a19b-1cbc-41f3-afed-5a72a924692b req-fc0969f7-9253-4f7b-a4d4-e223ba70eedf service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.116799 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-d569a19b-1cbc-41f3-afed-5a72a924692b req-fc0969f7-9253-4f7b-a4d4-e223ba70eedf service nova] Creating event network-changed:33a5e6ed-c63a-4e5f-a910-096813ddde2b for instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 on hv-cinder-82880 May 10 20:35:43.121626 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-d569a19b-1cbc-41f3-afed-5a72a924692b req-fc0969f7-9253-4f7b-a4d4-e223ba70eedf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038280 May 10 20:35:43.122299 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 486/946] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:43.172237 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:43.172940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:43.179364 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.179892 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.180761 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.181308 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.327007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:43.334284 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c8b9d735-7b2b-434f-bf9e-291a1bb6232b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1556 microversion: 2.1 time: 0.166457 May 10 20:35:43.335106 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 461/947] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:43 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:43.352391 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c7e54182-cd19-4293-b94e-8249b69616c7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:43.353003 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c7e54182-cd19-4293-b94e-8249b69616c7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:43.359652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c7e54182-cd19-4293-b94e-8249b69616c7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.360651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c7e54182-cd19-4293-b94e-8249b69616c7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.361673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c7e54182-cd19-4293-b94e-8249b69616c7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.362134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c7e54182-cd19-4293-b94e-8249b69616c7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.441714 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c7e54182-cd19-4293-b94e-8249b69616c7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093699 May 10 20:35:43.442312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 487/948] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:35:43 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:43.951607 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:43.952230 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:43.958756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.959215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:43.960008 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:43.960480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:44.462950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:44.470867 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-baaaf2ac-fea7-4ab6-a9e8-e773ab63b066 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.524513 May 10 20:35:44.471438 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 462/949] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:43 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:44.773148 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-55e9a860-8741-406e-83ba-ed503668a202 req-0cdd4865-ede7-45ec-857b-8b4398d4ed68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f81a471-e87d-4336-aa77-0d7e92083006", "tag": "9e2b91ca-1948-41ee-bd5e-aaf850ff56e1"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:44.781150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-55e9a860-8741-406e-83ba-ed503668a202 req-0cdd4865-ede7-45ec-857b-8b4398d4ed68 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:44.781604 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-55e9a860-8741-406e-83ba-ed503668a202 req-0cdd4865-ede7-45ec-857b-8b4398d4ed68 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:44.792420 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-55e9a860-8741-406e-83ba-ed503668a202 req-0cdd4865-ede7-45ec-857b-8b4398d4ed68 service nova] Creating event network-changed:9e2b91ca-1948-41ee-bd5e-aaf850ff56e1 for instance 9f81a471-e87d-4336-aa77-0d7e92083006 on hv-cinder-82880 May 10 20:35:44.797770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-55e9a860-8741-406e-83ba-ed503668a202 req-0cdd4865-ede7-45ec-857b-8b4398d4ed68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028875 May 10 20:35:44.798365 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 488/950] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:45.487467 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:45.488215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:45.494944 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:45.495397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:45.496199 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:45.496632 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:45.629250 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:45.636846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-5b7ebe28-7303-4cde-a742-204186805828 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.153106 May 10 20:35:45.637436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 463/951] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:45 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:46.655838 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:46.656541 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:46.662930 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:46.663414 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:46.664192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:46.664635 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:46.795869 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:46.803196 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e06f9407-4fbe-423d-846c-c30d627181b9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.152556 May 10 20:35:46.803760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 489/952] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:46 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:47.819541 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:47.820151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:47.826972 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:47.827423 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:47.828186 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:47.828622 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:47.953472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:47.960628 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cc31efab-d781-4af1-936b-e515fa85e6db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.144897 May 10 20:35:47.961219 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 464/953] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:47 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:48.978092 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:48.978734 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:48.985777 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:48.986233 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:48.987011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:48.987452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:49.113678 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:49.120888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8fc3faec-9730-45ac-b5b0-0eb8b9ae20c9 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.146765 May 10 20:35:49.121485 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 490/954] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:48 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:50.137549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:50.138162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:50.144728 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:50.145205 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:50.145963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:50.146402 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:50.275333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:50.282964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-944f23a7-1e6b-4125-8644-60089b6dc7ea tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.149290 May 10 20:35:50.283527 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 465/955] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:50 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:51.300029 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:51.300645 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:51.307013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:51.307467 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:51.308241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:51.308684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:51.440397 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:51.447935 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-464245cd-1c71-4786-86f6-eb5b556e89b4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.151685 May 10 20:35:51.448522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 491/956] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:51 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:52.465040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:52.465658 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:52.471934 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:52.472377 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:52.473169 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:52.473606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:52.602051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:52.609895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cf511595-4f98-4ff3-b862-35c16ddbb7da tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.148771 May 10 20:35:52.610451 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 466/957] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:52 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:53.292543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-8e2bc9c9-db07-4413-8ae0-459329274861 req-ccb474db-834e-4deb-ac27-d540bd4782d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc43bb45-4300-4d9e-81e8-3ac1dfc77246", "name": "network-vif-plugged", "status": "completed", "tag": "33a5e6ed-c63a-4e5f-a910-096813ddde2b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:53.301180 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-8e2bc9c9-db07-4413-8ae0-459329274861 req-ccb474db-834e-4deb-ac27-d540bd4782d4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:53.301634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-8e2bc9c9-db07-4413-8ae0-459329274861 req-ccb474db-834e-4deb-ac27-d540bd4782d4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:53.313888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-8e2bc9c9-db07-4413-8ae0-459329274861 req-ccb474db-834e-4deb-ac27-d540bd4782d4 service nova] Creating event network-vif-plugged:33a5e6ed-c63a-4e5f-a910-096813ddde2b for instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 on hv-cinder-82880 May 10 20:35:53.318835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-8e2bc9c9-db07-4413-8ae0-459329274861 req-ccb474db-834e-4deb-ac27-d540bd4782d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029941 May 10 20:35:53.319442 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 492/958] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:35:53.626917 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:53.627535 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:53.633883 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:53.634335 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:53.635103 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:53.635542 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:53.768856 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:53.776144 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-332ccf1a-ad47-43ca-b254-eded4c65f4a8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.153116 May 10 20:35:53.776702 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 467/959] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:53 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:54.792737 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:54.793429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:54.800330 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:54.800786 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:54.801591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:54.802039 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:54.933658 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:54.940889 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7be2207a-6208-494e-a555-55d4bfa723bb tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1259 microversion: 2.1 time: 0.152965 May 10 20:35:54.941475 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 493/960] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:54 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:55.956722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:55.957354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:55.963635 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:55.964064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:55.964828 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:55.965298 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:56.093300 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:56.100451 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bd2b7ff3-7c6f-4221-aaf1-5dff68108242 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1443 microversion: 2.1 time: 0.147598 May 10 20:35:56.101019 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 468/961] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:55 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:56.116720 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:35:56.117389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:35:56.124384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:56.124837 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:56.125652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:56.126093 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:56.253733 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:35:56.261040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ba1f7c0d-8e25-43c6-980f-43823dc4b385 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1443 microversion: 2.1 time: 0.148123 May 10 20:35:56.261599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 494/962] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:35:56 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:35:57.952328 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-d63eb105-b026-4fcd-bbd8-0e7fcfa1eb42 req-fd501866-873d-4ef5-a3e8-29d52e55f62f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc43bb45-4300-4d9e-81e8-3ac1dfc77246", "tag": "33a5e6ed-c63a-4e5f-a910-096813ddde2b"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:35:57.961912 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-d63eb105-b026-4fcd-bbd8-0e7fcfa1eb42 req-fd501866-873d-4ef5-a3e8-29d52e55f62f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:35:57.962364 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-d63eb105-b026-4fcd-bbd8-0e7fcfa1eb42 req-fd501866-873d-4ef5-a3e8-29d52e55f62f service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:35:57.973810 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-d63eb105-b026-4fcd-bbd8-0e7fcfa1eb42 req-fd501866-873d-4ef5-a3e8-29d52e55f62f service nova] Creating event network-changed:33a5e6ed-c63a-4e5f-a910-096813ddde2b for instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 on hv-cinder-82880 May 10 20:35:57.979050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-d63eb105-b026-4fcd-bbd8-0e7fcfa1eb42 req-fd501866-873d-4ef5-a3e8-29d52e55f62f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031149 May 10 20:35:57.980050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 469/963] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:20.642104 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-af7f25b5-b2af-4cde-99ba-6dd92d16e288 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:20.642711 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-af7f25b5-b2af-4cde-99ba-6dd92d16e288 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:20.649284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-af7f25b5-b2af-4cde-99ba-6dd92d16e288 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:20.649739 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-af7f25b5-b2af-4cde-99ba-6dd92d16e288 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:20.650513 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-af7f25b5-b2af-4cde-99ba-6dd92d16e288 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:20.650954 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-af7f25b5-b2af-4cde-99ba-6dd92d16e288 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:20.673870 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-af7f25b5-b2af-4cde-99ba-6dd92d16e288 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/ips" status: 200 len: 149 microversion: 2.1 time: 0.035871 May 10 20:36:20.674430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 495/964] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:36:20 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:22.010807 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d1643a94-e676-4b73-bdbb-58a89c03f2f1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdc7f4db-088d-4d29-9ff7-8150402fd65b"}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:22.011949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d1643a94-e676-4b73-bdbb-58a89c03f2f1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:22.018441 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d1643a94-e676-4b73-bdbb-58a89c03f2f1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:22.018889 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d1643a94-e676-4b73-bdbb-58a89c03f2f1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:22.019647 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d1643a94-e676-4b73-bdbb-58a89c03f2f1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:22.020080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d1643a94-e676-4b73-bdbb-58a89c03f2f1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:22.252077 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d1643a94-e676-4b73-bdbb-58a89c03f2f1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.245342 May 10 20:36:22.252747 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 470/965] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:36:22 2022] POST /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:29.726169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-13c114e9-fb35-4409-8189-51f7f2bcaaf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: .version_select at 0x7fb2731c6700>, body: {"keypair": {"name": "tempest-keypair-1766783348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwUvdGgqQ9xutBhqhpLg1DtxcAZrc+lhrVEogtB4zo7M6sT2MqI7fLg5bKCLrURxXei2mumwGUEj7pF2OUGMhsNHrA66yOEg+PIIj6V9740FGBsuNbxi+9HMnEM2WX7rA=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:29.739746 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-13c114e9-fb35-4409-8189-51f7f2bcaaf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:36:29.743831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-13c114e9-fb35-4409-8189-51f7f2bcaaf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:36:29.767706 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-13c114e9-fb35-4409-8189-51f7f2bcaaf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045528 May 10 20:36:29.768311 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 496/966] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:36:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:30.955051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1825417614", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86bfbdf-9b8b-4914-a508-1afa24268f93"}], "security_groups": [{"name": "tempest-securitygroup--1655057334"}], "key_name": "tempest-keypair-1766783348", "user_data": "}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:31.053857 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] validate_networks() for [('e86bfbdf-9b8b-4914-a508-1afa24268f93', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:36:31.407481 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:36:31.407847 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:36:31.408314 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:36:31.408717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:36:31.409165 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:36:31.417526 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:31.417997 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:31.418793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:31.419227 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:31.434950 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:36:31.438790 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:36:31.449730 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:36:31.452006 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:36:31.497498 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c5c30fc3-8b74-433f-ba6f-ea66704617e9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.547446 May 10 20:36:31.498327 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 471/967] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:36:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:36:31.508127 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f101fd29-3bbc-4370-b3c3-1f64238520cc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:31.508834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f101fd29-3bbc-4370-b3c3-1f64238520cc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:31.563455 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f101fd29-3bbc-4370-b3c3-1f64238520cc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:31.570807 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f101fd29-3bbc-4370-b3c3-1f64238520cc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1242 microversion: 2.1 time: 0.066585 May 10 20:36:31.571378 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 497/968] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:31 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:32.589037 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:32.589676 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:32.597183 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:32.597646 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:32.598428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:32.598867 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:32.665672 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:32.673041 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-34304131-2151-4f0d-9acf-6840e33f9bd1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1312 microversion: 2.1 time: 0.088439 May 10 20:36:32.673791 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 472/969] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:32 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1312 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:33.150084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2030996894", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-786161446", "security_groups": [{"name": "tempest-secgroup-smoke-1677145085"}], "block_device_mapping_v2": [{"uuid": "569e1483-8f25-400e-b1cb-1272dbe2c0cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f9d88ce3-6580-4789-923a-dc95426320f4"}]}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:33.270527 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] validate_networks() for [('f9d88ce3-6580-4789-923a-dc95426320f4', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:36:33.701458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:33.709312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:33.727934 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:33.731266 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:33.732834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:33.734610 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:34.049068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:36:34.049421 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:36:34.050206 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:36:34.050788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:36:34.051368 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:36:34.065633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:34.066085 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:34.066906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:34.067347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:34.082223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:34.090470 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1445c12c-94bd-4461-b8f2-33fc85e35566 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1368 microversion: 2.1 time: 0.402409 May 10 20:36:34.093154 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 473/970] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:33 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1368 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:34.109162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:36:34.113283 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Getting quotas for user 17f6eadae19c4b7b8bd66e21ae302363 and project 890bf13c89b748b3a8f9ba4106c582b3. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:36:34.173703 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:36:34.176458 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='569e1483-8f25-400e-b1cb-1272dbe2c0cc',volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:36:34.200857 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-72722243-930b-4bdf-817c-b3cc33761d42 req-0a202636-a52f-4b25-94bb-49e853486a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f111b0-4604-45b5-a76d-3fa27630e35f", "tag": "f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:34.212167 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-72722243-930b-4bdf-817c-b3cc33761d42 req-0a202636-a52f-4b25-94bb-49e853486a54 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:34.213038 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-72722243-930b-4bdf-817c-b3cc33761d42 req-0a202636-a52f-4b25-94bb-49e853486a54 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:34.249583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-72722243-930b-4bdf-817c-b3cc33761d42 req-0a202636-a52f-4b25-94bb-49e853486a54 service nova] Creating event network-changed:f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f for instance b0f111b0-4604-45b5-a76d-3fa27630e35f on hv-cinder-82880 May 10 20:36:34.256139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-72722243-930b-4bdf-817c-b3cc33761d42 req-0a202636-a52f-4b25-94bb-49e853486a54 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062429 May 10 20:36:34.257484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 474/971] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:34.341053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-bfb60385-c9a6-49f2-a9cf-0be7428e525f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.194723 May 10 20:36:34.346590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 498/972] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:36:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:36:34.352350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-89624bf7-489c-447a-b9f3-3b0827489daa tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:34.353097 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-89624bf7-489c-447a-b9f3-3b0827489daa tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:34.421422 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-89624bf7-489c-447a-b9f3-3b0827489daa tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:34.428228 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-89624bf7-489c-447a-b9f3-3b0827489daa tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1094 microversion: 2.1 time: 0.080059 May 10 20:36:34.428796 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 475/973] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:34 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:35.109542 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:35.110156 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:35.116760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:35.117236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:35.118013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:35.118450 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:35.246837 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:35.254084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-aee90a17-63cc-4d00-b50a-66f8dce9edc5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1368 microversion: 2.1 time: 0.149136 May 10 20:36:35.254651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 499/974] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:35 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:35.445624 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:35.446237 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:35.453764 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:35.454210 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:35.454979 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:35.455417 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:35.516686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:35.524176 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0d9bf555-869e-4667-a8fc-db32a87d3826 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1144 microversion: 2.1 time: 0.082694 May 10 20:36:35.524776 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 476/975] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:35 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:36.271214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:36.271935 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:36.278472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:36.279006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:36.279861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:36.280303 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:36.413164 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:36.421263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c40d543a-4bd1-430d-a404-09b72bc6fdf7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1368 microversion: 2.1 time: 0.153935 May 10 20:36:36.421835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 500/976] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:36 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:36.541415 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:36.542030 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:36.549140 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:36.549834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:36.550809 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:36.551252 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:36.615379 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:36.624298 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-72208f60-9068-4bee-bd41-46e190868c34 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1210 microversion: 2.1 time: 0.086703 May 10 20:36:36.625254 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 477/977] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:36 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:37.439526 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:37.440570 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:37.447503 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:37.448148 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:37.449647 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:37.450263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:37.496563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-7f621d5c-6d12-4645-ae98-c169c2baf548 req-185d971c-891d-42c0-843a-9c7951574c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8", "tag": "7b8363ce-797d-4e6c-9ee6-edd52830ef17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:37.508354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-7f621d5c-6d12-4645-ae98-c169c2baf548 req-185d971c-891d-42c0-843a-9c7951574c3a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:37.508718 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-7f621d5c-6d12-4645-ae98-c169c2baf548 req-185d971c-891d-42c0-843a-9c7951574c3a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:37.536304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-7f621d5c-6d12-4645-ae98-c169c2baf548 req-185d971c-891d-42c0-843a-9c7951574c3a service nova] Creating event network-changed:7b8363ce-797d-4e6c-9ee6-edd52830ef17 for instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 on hv-cinder-82880 May 10 20:36:37.541754 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-7f621d5c-6d12-4645-ae98-c169c2baf548 req-185d971c-891d-42c0-843a-9c7951574c3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049031 May 10 20:36:37.543084 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 478/978] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:36:37.628346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:37.640609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-168e171f-378b-44aa-b3ab-9e9ab6b021e1 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1368 microversion: 2.1 time: 0.206008 May 10 20:36:37.650322 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:37.650322 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:37.652668 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 501/979] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:37 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1368 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:37.653714 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:37.654229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:37.655260 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:37.656350 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:37.807316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:37.815229 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-93b05328-7256-46ec-aa0f-fdf9ea2cf523 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.178142 May 10 20:36:37.815798 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 479/980] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:37 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:38.658487 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:38.659092 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:38.665591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:38.666038 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:38.666800 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:38.667263 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:38.792046 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:38.799127 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c56ae283-55fa-41f0-abb8-67034f1154fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1368 microversion: 2.1 time: 0.144498 May 10 20:36:38.799691 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 502/981] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:38 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:38.832404 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:38.833045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:38.839371 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:38.839824 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:38.841201 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:38.841643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:38.967151 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:38.974692 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c98f0825-bbde-4b52-aa17-c981e90fbb08 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.146023 May 10 20:36:38.975252 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 480/982] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:38 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:39.588190 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-4c9e8c7a-11c8-4a3d-9ee9-f7effc58d0f7 req-e752c03f-839b-425d-b666-db6fb80abf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f111b0-4604-45b5-a76d-3fa27630e35f", "name": "network-vif-plugged", "status": "completed", "tag": "f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:39.598195 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-4c9e8c7a-11c8-4a3d-9ee9-f7effc58d0f7 req-e752c03f-839b-425d-b666-db6fb80abf90 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:39.598653 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-4c9e8c7a-11c8-4a3d-9ee9-f7effc58d0f7 req-e752c03f-839b-425d-b666-db6fb80abf90 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:39.610193 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-4c9e8c7a-11c8-4a3d-9ee9-f7effc58d0f7 req-e752c03f-839b-425d-b666-db6fb80abf90 service nova] Creating event network-vif-plugged:f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f for instance b0f111b0-4604-45b5-a76d-3fa27630e35f on hv-cinder-82880 May 10 20:36:39.615258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-4c9e8c7a-11c8-4a3d-9ee9-f7effc58d0f7 req-e752c03f-839b-425d-b666-db6fb80abf90 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031196 May 10 20:36:39.615855 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 503/983] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:39.815670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:39.816293 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:39.822501 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:39.822962 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:39.823750 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:39.824198 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:39.953023 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:39.960213 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-62836420-539e-4977-8721-00fcc54f11e7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1368 microversion: 2.1 time: 0.148428 May 10 20:36:39.960775 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 481/984] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:39 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:39.990912 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:39.991612 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:39.998194 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:39.998640 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:39.999402 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:39.999841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:40.128315 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:40.135760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d4f24b95-6ab4-4ae4-8852-70db2ff5509f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.149026 May 10 20:36:40.136328 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 504/985] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:39 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:40.983883 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:40.984497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:40.990822 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:40.991269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:40.992033 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:40.992466 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:41.119820 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:41.127946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ced05d74-2a22-447d-ac83-cf4502586d53 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1559 microversion: 2.1 time: 0.148477 May 10 20:36:41.128506 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 482/986] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:40 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:41.143993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3c95c31a-890b-418d-9188-6f79d76d71fc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:41.144479 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3c95c31a-890b-418d-9188-6f79d76d71fc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:41.150833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c95c31a-890b-418d-9188-6f79d76d71fc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:41.151290 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c95c31a-890b-418d-9188-6f79d76d71fc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:41.152095 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c95c31a-890b-418d-9188-6f79d76d71fc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:41.152541 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3c95c31a-890b-418d-9188-6f79d76d71fc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:41.153331 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:41.153979 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:41.159724 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:41.160177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:41.161002 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:41.161459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:41.254256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3c95c31a-890b-418d-9188-6f79d76d71fc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.114372 May 10 20:36:41.260896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 505/987] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:36:41 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:41.325928 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:41.333316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cbe4eacc-7bf7-4b95-bf43-4d775bc4a309 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.183900 May 10 20:36:41.333876 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 483/988] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:41 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:36:42.352248 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:42.352831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:42.359544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:42.360084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:42.360916 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:42.361409 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:42.461970 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-8bfab5dd-e957-4591-b211-7b0ef8872212 req-7ca9ede5-66e2-40d2-877f-690c8cd84888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0f111b0-4604-45b5-a76d-3fa27630e35f", "tag": "f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:42.471091 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-8bfab5dd-e957-4591-b211-7b0ef8872212 req-7ca9ede5-66e2-40d2-877f-690c8cd84888 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:42.471487 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-8bfab5dd-e957-4591-b211-7b0ef8872212 req-7ca9ede5-66e2-40d2-877f-690c8cd84888 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:42.483462 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-8bfab5dd-e957-4591-b211-7b0ef8872212 req-7ca9ede5-66e2-40d2-877f-690c8cd84888 service nova] Creating event network-changed:f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f for instance b0f111b0-4604-45b5-a76d-3fa27630e35f on hv-cinder-82880 May 10 20:36:42.488667 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-8bfab5dd-e957-4591-b211-7b0ef8872212 req-7ca9ede5-66e2-40d2-877f-690c8cd84888 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030260 May 10 20:36:42.489733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 484/989] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:42.504344 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:42.512341 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-77af81cf-bcd0-4116-a3ff-be18d764ca93 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.164026 May 10 20:36:42.512909 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 506/990] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:42 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:43.530983 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:43.531781 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:43.538550 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:43.538902 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:43.539723 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:43.540098 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:43.668207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:43.676028 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6708cabe-080a-4c14-b5fb-9beddcf66753 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.150341 May 10 20:36:43.676591 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 485/991] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:43 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:44.692952 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:44.693635 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:44.700376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:44.700831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:44.701642 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:44.702086 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:44.832192 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:44.839612 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f0eecc1f-83b9-4fc4-8486-32459d1a083c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.150671 May 10 20:36:44.840837 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 507/992] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:44 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:45.856789 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:45.857428 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:45.863842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:45.864290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:45.865092 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:45.865531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:45.998658 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:46.005982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f679ee55-51b9-47da-8723-eb12c0f4c9f1 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.153027 May 10 20:36:46.006550 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 486/993] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:45 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:47.024553 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:47.025219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:47.032179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:47.032634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:47.033440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:47.033890 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:47.163539 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:47.170845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a94f987b-dcef-479f-99c1-97995e80a3c0 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.150193 May 10 20:36:47.171406 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 508/994] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:47 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:47.676474 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-5166e280-0e88-433f-8ed7-5817b522dbe7 req-71c3d92f-76eb-4db2-9812-3865e5a55d37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8", "name": "network-vif-plugged", "status": "completed", "tag": "7b8363ce-797d-4e6c-9ee6-edd52830ef17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:47.686181 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-5166e280-0e88-433f-8ed7-5817b522dbe7 req-71c3d92f-76eb-4db2-9812-3865e5a55d37 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:47.686793 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-5166e280-0e88-433f-8ed7-5817b522dbe7 req-71c3d92f-76eb-4db2-9812-3865e5a55d37 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:47.698211 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-5166e280-0e88-433f-8ed7-5817b522dbe7 req-71c3d92f-76eb-4db2-9812-3865e5a55d37 service nova] Creating event network-vif-plugged:7b8363ce-797d-4e6c-9ee6-edd52830ef17 for instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 on hv-cinder-82880 May 10 20:36:47.704568 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-5166e280-0e88-433f-8ed7-5817b522dbe7 req-71c3d92f-76eb-4db2-9812-3865e5a55d37 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 May 10 20:36:47.705181 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 487/995] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:36:48.187039 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:48.187646 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:48.193997 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:48.194446 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:48.195204 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:48.195639 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:48.323662 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:48.330877 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3e83ded7-5ec1-4132-8074-04fba7983707 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1266 microversion: 2.1 time: 0.147766 May 10 20:36:48.331441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 509/996] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:48 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:49.347720 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:49.348345 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:49.354927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:49.355378 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:49.356179 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:49.356615 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:49.484587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:49.491833 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-55d01c23-c9b1-4721-865e-a4d3b6d37f47 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1453 microversion: 2.1 time: 0.148389 May 10 20:36:49.492397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 488/997] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:49 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:49.508037 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:36:49.508645 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:36:49.515739 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:49.516203 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:49.517247 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:49.517684 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:49.648906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:36:49.656376 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-5a0eeeeb-1720-4fca-b3b7-dc6a3d7502b2 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1453 microversion: 2.1 time: 0.152113 May 10 20:36:49.656946 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 510/998] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:36:49 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:36:51.643573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-a7111caa-7ad6-4447-884b-3e7891bb1360 req-6ba6fb8f-1ec2-46f5-b001-009c70309934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8", "tag": "7b8363ce-797d-4e6c-9ee6-edd52830ef17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:36:51.652280 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-a7111caa-7ad6-4447-884b-3e7891bb1360 req-6ba6fb8f-1ec2-46f5-b001-009c70309934 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:36:51.652814 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-a7111caa-7ad6-4447-884b-3e7891bb1360 req-6ba6fb8f-1ec2-46f5-b001-009c70309934 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:36:51.664497 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-a7111caa-7ad6-4447-884b-3e7891bb1360 req-6ba6fb8f-1ec2-46f5-b001-009c70309934 service nova] Creating event network-changed:7b8363ce-797d-4e6c-9ee6-edd52830ef17 for instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 on hv-cinder-82880 May 10 20:36:51.670924 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-a7111caa-7ad6-4447-884b-3e7891bb1360 req-6ba6fb8f-1ec2-46f5-b001-009c70309934 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030912 May 10 20:36:51.672068 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 489/999] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:18.582403 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4d6adf55-86dc-4d3d-b9ef-6cea1ca604f6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:18.582977 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4d6adf55-86dc-4d3d-b9ef-6cea1ca604f6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:18.588817 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d6adf55-86dc-4d3d-b9ef-6cea1ca604f6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.589296 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d6adf55-86dc-4d3d-b9ef-6cea1ca604f6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.590064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d6adf55-86dc-4d3d-b9ef-6cea1ca604f6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.590500 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4d6adf55-86dc-4d3d-b9ef-6cea1ca604f6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.613241 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4d6adf55-86dc-4d3d-b9ef-6cea1ca604f6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f/ips" status: 200 len: 150 microversion: 2.1 time: 0.034851 May 10 20:37:18.613788 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 511/1000] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:37:18 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:18.626699 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cdc7f4db-088d-4d29-9ff7-8150402fd65b"}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:18.627838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:18.634045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.634489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.635265 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.635707 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.766964 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Invalid volume: volume cdc7f4db-088d-4d29-9ff7-8150402fd65b is already attached to instances: 9f81a471-e87d-4336-aa77-0d7e92083006 May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: POST /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f/os-volume_attachments HTTP/1.1 May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 74 May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:37:18.768949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {"volumeAttachment": {"volumeId": "cdc7f4db-088d-4d29-9ff7-8150402fd65b"}} May 10 20:37:18.770616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Invalid volume: volume cdc7f4db-088d-4d29-9ff7-8150402fd65b is already attached to instances: 9f81a471-e87d-4336-aa77-0d7e92083006 May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'server_id': 'b0f111b0-4604-45b5-a76d-3fa27630e35f', 'body': {'volumeAttachment': {'volumeId': 'cdc7f4db-088d-4d29-9ff7-8150402fd65b'}}} May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cdc7f4db-088d-4d29-9ff7-8150402fd65b is already attached to instances: 9f81a471-e87d-4336-aa77-0d7e92083006 May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:37:18.771621 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cdc7f4db-088d-4d29-9ff7-8150402fd65b is already attached to instances: 9f81a471-e87d-4336-aa77-0d7e92083006 May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:18.772887 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cdc7f4db-088d-4d29-9ff7-8150402fd65b is already attached to instances: 9f81a471-e87d-4336-aa77-0d7e92083006 May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 400 to user: Invalid volume: volume cdc7f4db-088d-4d29-9ff7-8150402fd65b is already attached to instances: 9f81a471-e87d-4336-aa77-0d7e92083006 {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4f7f0c6e-d377-456d-bec1-6f701b090a8a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.149403 May 10 20:37:18.774253 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 490/1001] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:37:18 2022] POST /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f/os-volume_attachments => generated 174 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:37:18.779590 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:18.780084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:18.786079 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.786535 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.787291 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.787723 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.812440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:37:18.885170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2fec4dd2-702d-445b-b491-b903d39dc5ee tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 204 len: 0 microversion: 2.1 time: 0.109637 May 10 20:37:18.885941 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 512/1002] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:37:18 2022] DELETE /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:37:18.895231 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:18.895834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:18.904357 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.904804 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:18.905780 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:18.906224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:19.031289 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:19.038509 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4a8c35b9-1277-43fd-a7a6-71b3c14631ea tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1683 microversion: 2.1 time: 0.147524 May 10 20:37:19.039059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 491/1003] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:18 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:20.056309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:20.056938 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:20.063219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:20.063665 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:20.064430 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:20.064864 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:20.241445 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:20.249269 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a71695e2-2e8e-4890-984e-c93bc1b687cd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1683 microversion: 2.1 time: 0.197240 May 10 20:37:20.249833 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 513/1004] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:20 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:21.267281 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:21.268353 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:21.275213 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:21.275668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:21.276449 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:21.276883 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:21.304575 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-61b558c1-4126-43bb-b315-70e3ff6ad27f req-c4f7db86-6bbc-4c3b-8bba-7587175b4aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0f111b0-4604-45b5-a76d-3fa27630e35f", "name": "network-vif-deleted", "tag": "f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:21.316773 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-61b558c1-4126-43bb-b315-70e3ff6ad27f req-c4f7db86-6bbc-4c3b-8bba-7587175b4aba service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:21.316773 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-61b558c1-4126-43bb-b315-70e3ff6ad27f req-c4f7db86-6bbc-4c3b-8bba-7587175b4aba service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:21.348449 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-61b558c1-4126-43bb-b315-70e3ff6ad27f req-c4f7db86-6bbc-4c3b-8bba-7587175b4aba service nova] Creating event network-vif-deleted:f64eb0b8-47ba-4387-b8f9-cea8bbd7d67f for instance b0f111b0-4604-45b5-a76d-3fa27630e35f on hv-cinder-82880 May 10 20:37:21.348643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:21.356766 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-69e2babf-51f2-4322-a902-26c9f5c5e3c5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 200 len: 1615 microversion: 2.1 time: 0.094124 May 10 20:37:21.359633 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-61b558c1-4126-43bb-b315-70e3ff6ad27f req-c4f7db86-6bbc-4c3b-8bba-7587175b4aba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058371 May 10 20:37:21.361012 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 514/1005] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:37:21.361367 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 492/1006] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:21 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:22.378685 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:22.379380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:22.385806 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:22.386260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:22.387031 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:22.387464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:22.401322 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f HTTP/1.1 May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:37:22.402920 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:37:22.405257 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'b0f111b0-4604-45b5-a76d-3fa27630e35f'} May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:37:22.406178 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:37:22.407696 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:22.409140 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:37:22.409140 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d8695154-61fe-43cb-8c83-1a050d63a45b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 404 len: 111 microversion: 2.1 time: 0.030258 May 10 20:37:22.409140 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 515/1007] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:22 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:37:22.413553 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-acf35acc-0f96-4ec4-a029-d58fa26a9cac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '.version_select at 0x7fb2781340d0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:22.430500 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-acf35acc-0f96-4ec4-a029-d58fa26a9cac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766783348" status: 202 len: 0 microversion: 2.1 time: 0.020610 May 10 20:37:22.431051 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 493/1008] 10.222.0.61 () {58 vars in 1220 bytes} [Tue May 10 20:37:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766783348 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:37:23.066243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:23.066744 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:23.072552 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:23.073032 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:23.073802 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:23.074244 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:23.151686 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lazy-loading 'services' on Instance uuid 9f81a471-e87d-4336-aa77-0d7e92083006 {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:37:23.227105 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-134eddb0-6ed1-4f99-b19a-141798c368dd tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments/cdc7f4db-088d-4d29-9ff7-8150402fd65b" status: 202 len: 0 microversion: 2.1 time: 0.164763 May 10 20:37:23.228437 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 516/1009] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:37:23 2022] DELETE /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments/cdc7f4db-088d-4d29-9ff7-8150402fd65b => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:37:23.236548 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-295a7afe-2a07-4614-8fb7-bf7482cd8a91 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:23.237618 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-295a7afe-2a07-4614-8fb7-bf7482cd8a91 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:23.244307 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-295a7afe-2a07-4614-8fb7-bf7482cd8a91 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:23.244670 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-295a7afe-2a07-4614-8fb7-bf7482cd8a91 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:23.245486 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-295a7afe-2a07-4614-8fb7-bf7482cd8a91 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:23.245952 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-295a7afe-2a07-4614-8fb7-bf7482cd8a91 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:23.276158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-295a7afe-2a07-4614-8fb7-bf7482cd8a91 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 May 10 20:37:23.276700 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 494/1010] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:37:23 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:24.288860 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-de10f0b1-423b-4e70-ae8d-400cc4c25e34 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:24.289959 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-de10f0b1-423b-4e70-ae8d-400cc4c25e34 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:24.296236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-de10f0b1-423b-4e70-ae8d-400cc4c25e34 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.296689 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-de10f0b1-423b-4e70-ae8d-400cc4c25e34 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.297499 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-de10f0b1-423b-4e70-ae8d-400cc4c25e34 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.297944 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-de10f0b1-423b-4e70-ae8d-400cc4c25e34 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.329368 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-de10f0b1-423b-4e70-ae8d-400cc4c25e34 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045256 May 10 20:37:24.329931 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 517/1011] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:37:24 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:37:24.388104 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:24.388722 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:24.395733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.396190 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.396965 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.397431 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.421575 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:37:24.494513 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-847a0310-95fb-4279-b6a7-70f265fc261b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 204 len: 0 microversion: 2.1 time: 0.109966 May 10 20:37:24.495078 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 495/1012] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:37:24 2022] DELETE /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:37:24.503653 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:24.504269 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:24.510106 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.510564 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.511337 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:24.511782 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:24.639967 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:24.647692 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-fdddb8c1-ad2c-45ef-9271-31586702f9ac tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1680 microversion: 2.1 time: 0.147992 May 10 20:37:24.648272 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 518/1013] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:24 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:25.665451 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:25.666167 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:25.672589 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:25.673072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:25.673850 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:25.674294 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:25.804246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:25.812388 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b50b0d16-76c3-4b1d-bf50-23169cd19e59 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1680 microversion: 2.1 time: 0.150772 May 10 20:37:25.813020 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 496/1014] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:25 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:26.828766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:26.829423 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:26.836047 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:26.836504 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:26.837345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:26.837789 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:26.907642 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:26.915670 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d2710e27-580e-471f-87a3-94d244cceee5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 200 len: 1613 microversion: 2.1 time: 0.090838 May 10 20:37:26.919825 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 519/1015] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:26 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 1613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:26.925089 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-3f09aa88-b9fb-4f2b-8198-3e9df257946a req-23b1cfaa-e852-4d4c-a4e3-6845703e95bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f81a471-e87d-4336-aa77-0d7e92083006", "name": "network-vif-deleted", "tag": "9e2b91ca-1948-41ee-bd5e-aaf850ff56e1"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:26.934570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-3f09aa88-b9fb-4f2b-8198-3e9df257946a req-23b1cfaa-e852-4d4c-a4e3-6845703e95bf service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:26.935225 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-3f09aa88-b9fb-4f2b-8198-3e9df257946a req-23b1cfaa-e852-4d4c-a4e3-6845703e95bf service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:26.947397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-3f09aa88-b9fb-4f2b-8198-3e9df257946a req-23b1cfaa-e852-4d4c-a4e3-6845703e95bf service nova] Creating event network-vif-deleted:9e2b91ca-1948-41ee-bd5e-aaf850ff56e1 for instance 9f81a471-e87d-4336-aa77-0d7e92083006 on hv-cinder-82880 May 10 20:37:26.954257 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-3f09aa88-b9fb-4f2b-8198-3e9df257946a req-23b1cfaa-e852-4d4c-a4e3-6845703e95bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033808 May 10 20:37:26.955164 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 497/1016] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:27.932791 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:27.933459 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:27.940418 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:27.940864 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:27.941844 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:27.942286 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:27.955854 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 HTTP/1.1 May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:37:27.957543 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:37:27.959125 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '9f81a471-e87d-4336-aa77-0d7e92083006'} May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:37:27.959943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:37:27.961249 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:37:27.962352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:37:27.962352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1384bf53-fde8-46f6-9a16-5d41f9545b74 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 404 len: 111 microversion: 2.1 time: 0.030072 May 10 20:37:27.962352 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 520/1017] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:27 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:37:27.969109 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-24519400-0af0-41ca-a881-083325673765 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '.version_select at 0x7fb27821ca60>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:27.988188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-24519400-0af0-41ca-a881-083325673765 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-316995153" status: 202 len: 0 microversion: 2.1 time: 0.023583 May 10 20:37:27.988770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 498/1018] 10.222.0.61 () {58 vars in 1217 bytes} [Tue May 10 20:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-316995153 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:37:28.610453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-012fe259-380d-4ad3-b128-fc6a27dbcf28 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: .version_select at 0x7fb2733ec820>, body: {"keypair": {"name": "tempest-keypair-963001731", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEM1MJp3E1acGNZZJT3/WvMVEIms+Ztx7QnGh1P0JUqoDHuM+8r43CtGUedEEOt6Saj1cfIpzm08YyTN1Gmb6O/LJJKAlB96RHqQuaWf+6kM2/lmPseVkXST74hZ58shIw=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:28.626493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-012fe259-380d-4ad3-b128-fc6a27dbcf28 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:37:28.630267 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-012fe259-380d-4ad3-b128-fc6a27dbcf28 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:37:28.651651 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-012fe259-380d-4ad3-b128-fc6a27dbcf28 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047109 May 10 20:37:28.652227 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 521/1019] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:37:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:29.817438 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-994503720", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86bfbdf-9b8b-4914-a508-1afa24268f93"}], "security_groups": [{"name": "tempest-securitygroup--97572786"}], "key_name": "tempest-keypair-963001731", "user_data": "}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:29.916576 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.network.neutron [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] validate_networks() for [('e86bfbdf-9b8b-4914-a508-1afa24268f93', None, None, None, None, None)] {{(pid=117260) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:37:30.266805 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:37:30.267225 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image limits 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:37:30.267701 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:37:30.268104 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image pref 0:0:0 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:37:30.268767 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.virt.hardware [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117260) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:37:30.277372 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:30.277818 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:30.278615 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:30.279050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:30.295347 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:37:30.299148 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.quota [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117260) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:37:30.309482 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Going to run 1 instances... {{(pid=117260) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:37:30.312258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117260) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:37:30.356249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-74d30713-8d83-49b7-9b13-2a1000ee97b3 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.543582 May 10 20:37:30.356958 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 499/1020] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:37:29 2022] POST /compute/v2.1/servers => generated 400 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:37:30.367453 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b70b2ba8-deaf-4d88-88a1-f87f4c653f38 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:30.368064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b70b2ba8-deaf-4d88-88a1-f87f4c653f38 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:30.422708 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b70b2ba8-deaf-4d88-88a1-f87f4c653f38 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:30.430180 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b70b2ba8-deaf-4d88-88a1-f87f4c653f38 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1240 microversion: 2.1 time: 0.067055 May 10 20:37:30.430861 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 522/1021] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:30 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:31.448588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:31.449848 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:31.457250 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:31.457995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:31.458777 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:31.459215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:31.528414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:31.536696 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7a574c19-4c14-4e48-9960-6c0d38e21a44 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1310 microversion: 2.1 time: 0.093155 May 10 20:37:31.546711 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 500/1022] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:31 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1310 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:32.553874 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:32.554673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:32.561876 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:32.562729 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:32.563548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:32.563970 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:32.693133 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:32.700674 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-392c0bca-d4eb-4f18-a936-0d12dba48ed9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1364 microversion: 2.1 time: 0.150627 May 10 20:37:32.701337 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 523/1023] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:32 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:33.060153 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-afcdb30d-67f3-45ee-b0bf-4030be6930a2 req-6c7f9700-4618-4b7d-8d99-9cfccc303480 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac587b8-5a1a-4955-9f6a-b8d63c638690", "tag": "71d8f2d8-1dec-478b-b542-46bf66fbad3b"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:33.070680 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-afcdb30d-67f3-45ee-b0bf-4030be6930a2 req-6c7f9700-4618-4b7d-8d99-9cfccc303480 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:33.071258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-afcdb30d-67f3-45ee-b0bf-4030be6930a2 req-6c7f9700-4618-4b7d-8d99-9cfccc303480 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:33.087472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-afcdb30d-67f3-45ee-b0bf-4030be6930a2 req-6c7f9700-4618-4b7d-8d99-9cfccc303480 service nova] Creating event network-changed:71d8f2d8-1dec-478b-b542-46bf66fbad3b for instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 on hv-cinder-82880 May 10 20:37:33.092638 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-afcdb30d-67f3-45ee-b0bf-4030be6930a2 req-6c7f9700-4618-4b7d-8d99-9cfccc303480 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036294 May 10 20:37:33.094198 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 501/1024] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:33.717624 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:33.718235 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:33.724573 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:33.725056 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:33.725825 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:33.726258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:33.853721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:33.861754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-81fe065d-4184-46b2-9fee-d5eea066ff0a tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1364 microversion: 2.1 time: 0.147921 May 10 20:37:33.862361 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 524/1025] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:33 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:34.879759 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:34.880531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:34.886607 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:34.887053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:34.887810 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:34.888246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:35.016117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:35.023893 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0d94ef8d-2a74-425b-a080-2c9bc3595ac4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1364 microversion: 2.1 time: 0.149284 May 10 20:37:35.024455 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 502/1026] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:34 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:36.040339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:36.040886 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:36.047362 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:36.047818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:36.048592 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:36.049064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:36.173357 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:36.180801 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-95dd19fd-0ff9-46ee-8642-5237917c548e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1364 microversion: 2.1 time: 0.144379 May 10 20:37:36.181405 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 525/1027] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:36 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:37.197512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:37.198134 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:37.204484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:37.204941 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:37.205744 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:37.206188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:37.331157 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:37.338360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fef383af-f559-41c0-8a85-c48d40ddac3c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1364 microversion: 2.1 time: 0.144868 May 10 20:37:37.338915 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 503/1028] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:37 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:38.027551 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-e4520864-7a4d-4b05-bbc4-7871089e0f8d req-02bab963-a97d-4092-94d1-b6ab978916ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac587b8-5a1a-4955-9f6a-b8d63c638690", "name": "network-vif-plugged", "status": "completed", "tag": "71d8f2d8-1dec-478b-b542-46bf66fbad3b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:38.036150 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-e4520864-7a4d-4b05-bbc4-7871089e0f8d req-02bab963-a97d-4092-94d1-b6ab978916ff service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:38.036599 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-e4520864-7a4d-4b05-bbc4-7871089e0f8d req-02bab963-a97d-4092-94d1-b6ab978916ff service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:38.050906 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-e4520864-7a4d-4b05-bbc4-7871089e0f8d req-02bab963-a97d-4092-94d1-b6ab978916ff service nova] Creating event network-vif-plugged:71d8f2d8-1dec-478b-b542-46bf66fbad3b for instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 on hv-cinder-82880 May 10 20:37:38.055805 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-e4520864-7a4d-4b05-bbc4-7871089e0f8d req-02bab963-a97d-4092-94d1-b6ab978916ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032179 May 10 20:37:38.056605 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 526/1029] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:38.355304 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:38.355919 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:38.362821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:38.363269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:38.364045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:38.364484 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:38.489947 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:38.504190 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-780c285b-5058-4494-8382-d2504e23f7d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1364 microversion: 2.1 time: 0.152661 May 10 20:37:38.504754 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 504/1030] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:38 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:39.522714 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:39.523411 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:39.529546 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:39.529997 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:39.530775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:39.531210 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:39.659314 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:39.666694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3cfcbf64-1d6f-4b42-bba3-19058550f4fb tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1555 microversion: 2.1 time: 0.148934 May 10 20:37:39.667262 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 527/1031] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:39 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:39.682593 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-16e69fb4-d63f-4097-a960-634e4a761b68 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:39.683072 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-16e69fb4-d63f-4097-a960-634e4a761b68 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:39.690140 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e69fb4-d63f-4097-a960-634e4a761b68 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:39.690590 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e69fb4-d63f-4097-a960-634e4a761b68 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:39.691607 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e69fb4-d63f-4097-a960-634e4a761b68 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:39.691881 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-16e69fb4-d63f-4097-a960-634e4a761b68 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:39.773085 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-16e69fb4-d63f-4097-a960-634e4a761b68 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094259 May 10 20:37:39.773630 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 505/1032] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:37:39 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:40.722845 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-9f4eec78-e14b-4a8f-8aa5-8ea154167ec3 req-df318258-8190-4269-b6c7-abd3ae26d4fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ac587b8-5a1a-4955-9f6a-b8d63c638690", "tag": "71d8f2d8-1dec-478b-b542-46bf66fbad3b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:40.731339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-9f4eec78-e14b-4a8f-8aa5-8ea154167ec3 req-df318258-8190-4269-b6c7-abd3ae26d4fe service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:40.731789 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-9f4eec78-e14b-4a8f-8aa5-8ea154167ec3 req-df318258-8190-4269-b6c7-abd3ae26d4fe service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:40.742820 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-9f4eec78-e14b-4a8f-8aa5-8ea154167ec3 req-df318258-8190-4269-b6c7-abd3ae26d4fe service nova] Creating event network-changed:71d8f2d8-1dec-478b-b542-46bf66fbad3b for instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 on hv-cinder-82880 May 10 20:37:40.747666 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-9f4eec78-e14b-4a8f-8aa5-8ea154167ec3 req-df318258-8190-4269-b6c7-abd3ae26d4fe service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029102 May 10 20:37:40.748270 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 528/1033] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:37:56.636557 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:37:56.637178 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:56.643630 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:56.644077 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:56.645117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:56.645554 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:56.670426 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lazy-loading 'flavor' on Instance uuid dc43bb45-4300-4d9e-81e8-3ac1dfc77246 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:37:56.750807 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cbbc87e2-7e42-4a4b-8cbe-f4cc2ab44605 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "POST /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246/action" status: 202 len: 0 microversion: 2.1 time: 0.118496 May 10 20:37:56.751409 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 506/1034] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:37:56 2022] POST /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:37:56.760609 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:56.761330 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:56.768452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:56.768950 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:56.770018 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:56.770468 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:56.897938 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:56.905284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0fc3f46b-a99d-403e-813f-ebcb269e9077 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.149445 May 10 20:37:56.905874 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 529/1035] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:56 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:57.923563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:57.924260 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:57.930443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:57.930896 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:57.931665 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:57.932105 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:58.061456 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:58.069271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-20a7446e-4ea9-49fd-ae1d-126467890975 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.150447 May 10 20:37:58.069834 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 507/1036] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:57 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:37:59.086272 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:37:59.086887 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:37:59.093775 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:59.094236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:59.095006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:37:59.095447 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:37:59.225044 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:37:59.232326 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3816f81b-b5c6-45ae-a0e2-d220e2e670ad tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.149920 May 10 20:37:59.232884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 530/1037] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:37:59 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:00.248741 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:00.249390 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:00.255423 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:00.255879 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:00.256664 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:00.257139 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:00.385034 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:00.392931 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-dfc5b4ac-6f37-40db-a375-04db1f7f6aa3 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.148028 May 10 20:38:00.393517 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 508/1038] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:00 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:01.412209 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:01.412825 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:01.419165 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:01.419616 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:01.420387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:01.420831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:01.546563 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:01.553849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4c3f7c39-dac0-40b1-8039-18f404799d00 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.145452 May 10 20:38:01.554417 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 531/1039] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:01 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:02.570524 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:02.571168 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:02.577529 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:02.577982 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:02.578753 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:02.579193 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:02.703731 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:02.711061 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-085c0ed8-bfa7-4fc7-83b9-2dcdab1b5206 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.144414 May 10 20:38:02.711617 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 509/1040] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:02 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:03.727634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:03.728179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:03.734496 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:03.735000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:03.735770 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:03.736205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:03.865230 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:03.872556 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ddb43343-c012-4745-826a-f0242ca5c759 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.148867 May 10 20:38:03.873153 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 532/1041] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:03 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:04.889202 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:04.889814 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:04.896319 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:04.896765 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:04.897554 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:04.897989 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:05.023826 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:05.032743 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f9a7d204-cf1a-4ae0-956e-62455ba4baa8 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.146889 May 10 20:38:05.033340 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 510/1042] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:04 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:06.050464 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:06.051074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:06.057434 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:06.057888 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:06.058667 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:06.059103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:06.190491 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:06.197859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-279ee1d3-ea74-477d-af84-58d498ca59e2 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.151898 May 10 20:38:06.198423 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 533/1043] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:06 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:07.214855 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:07.215466 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:07.222357 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:07.222818 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:07.223603 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:07.224045 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:07.350927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:07.358286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-64670dc2-f966-4137-8f8c-c06e6cc53232 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.147316 May 10 20:38:07.358846 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 511/1044] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:07 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:08.375245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:08.375883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:08.382218 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:08.382673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:08.383442 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:08.383879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:08.512311 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:08.520495 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-833ed6b2-bd9e-42bf-b4fc-8af855337164 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.149102 May 10 20:38:08.521080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 534/1045] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:08 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:09.537474 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:09.538110 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:09.544385 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.544832 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.545632 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.546064 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.673905 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:09.681642 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d9d560fd-d998-4778-afa6-193b8ad54346 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1568 microversion: 2.1 time: 0.148143 May 10 20:38:09.682204 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 512/1046] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:09 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:09.698399 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8b74ee9f-8faa-461e-96bf-ac7f49c18267 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:09.699051 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8b74ee9f-8faa-461e-96bf-ac7f49c18267 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:09.705345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8b74ee9f-8faa-461e-96bf-ac7f49c18267 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.705818 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8b74ee9f-8faa-461e-96bf-ac7f49c18267 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.706566 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8b74ee9f-8faa-461e-96bf-ac7f49c18267 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.707000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8b74ee9f-8faa-461e-96bf-ac7f49c18267 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.785138 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8b74ee9f-8faa-461e-96bf-ac7f49c18267 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "POST /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246/action" status: 202 len: 0 microversion: 2.1 time: 0.090626 May 10 20:38:09.785975 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 535/1047] 10.222.0.61 () {60 vars in 1277 bytes} [Tue May 10 20:38:09 2022] POST /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:38:09.793986 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:09.794531 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:09.801443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.801895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.802690 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:09.803202 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:09.941090 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:09.948392 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4ae63c15-e64f-48cb-a651-be701ee2d549 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1516 microversion: 2.1 time: 0.158226 May 10 20:38:09.948953 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 513/1048] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:09 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:10.966134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:10.966896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:10.973393 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:10.973840 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:10.974639 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:10.975146 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:11.104962 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:11.112301 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3ffab5d3-e695-4b66-bb89-ea57d594b227 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1574 microversion: 2.1 time: 0.150560 May 10 20:38:11.112865 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 536/1049] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:10 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:12.129437 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:12.130053 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:12.136363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:12.136817 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:12.137625 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:12.138066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:12.263599 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:12.271721 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-53923444-ef6c-4679-9ddb-2a8e926084a7 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1574 microversion: 2.1 time: 0.146159 May 10 20:38:12.272288 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 514/1050] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:12 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1574 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:13.288107 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:13.288628 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:13.295055 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:13.295501 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:13.296262 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:13.296693 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:13.426084 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:13.433408 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-53c346da-4da5-4086-a5ef-0c97e6680435 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1574 microversion: 2.1 time: 0.149175 May 10 20:38:13.433979 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 537/1051] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:13 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:14.143474 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-6344d13b-4731-4284-8421-7f28e4e92ceb req-70cbc420-3f5e-4b7a-a1cf-cd1b71377434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc43bb45-4300-4d9e-81e8-3ac1dfc77246", "name": "network-vif-unplugged", "status": "completed", "tag": "33a5e6ed-c63a-4e5f-a910-096813ddde2b"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:14.151981 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-6344d13b-4731-4284-8421-7f28e4e92ceb req-70cbc420-3f5e-4b7a-a1cf-cd1b71377434 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:14.152416 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-6344d13b-4731-4284-8421-7f28e4e92ceb req-70cbc420-3f5e-4b7a-a1cf-cd1b71377434 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:14.163580 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-6344d13b-4731-4284-8421-7f28e4e92ceb req-70cbc420-3f5e-4b7a-a1cf-cd1b71377434 service nova] Creating event network-vif-unplugged:33a5e6ed-c63a-4e5f-a910-096813ddde2b for instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 on hv-cinder-82880 May 10 20:38:14.168549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-6344d13b-4731-4284-8421-7f28e4e92ceb req-70cbc420-3f5e-4b7a-a1cf-cd1b71377434 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029510 May 10 20:38:14.169249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 515/1052] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:14.450119 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:14.450738 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:14.457208 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:14.457665 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:14.458438 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:14.458879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:14.585678 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:14.592919 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-931bfd61-c978-489b-a1b3-ad35729e1a8e tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1574 microversion: 2.1 time: 0.146682 May 10 20:38:14.593515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 538/1053] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:14 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:15.612208 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:15.612904 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:15.619062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:15.619536 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:15.620300 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:15.620734 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:15.745249 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:15.753242 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-23e47d7c-800b-4854-a42c-57ef6958d75b tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1574 microversion: 2.1 time: 0.146255 May 10 20:38:15.753798 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 516/1054] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:15 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:16.545469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-38df9e3d-87fa-4739-ba50-eeecd1e5f049 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:16.546000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-38df9e3d-87fa-4739-ba50-eeecd1e5f049 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:16.552236 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-38df9e3d-87fa-4739-ba50-eeecd1e5f049 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:16.552686 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-38df9e3d-87fa-4739-ba50-eeecd1e5f049 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:16.553488 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-38df9e3d-87fa-4739-ba50-eeecd1e5f049 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:16.553923 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-38df9e3d-87fa-4739-ba50-eeecd1e5f049 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:16.578329 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-38df9e3d-87fa-4739-ba50-eeecd1e5f049 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/ips" status: 200 len: 150 microversion: 2.1 time: 0.036648 May 10 20:38:16.578894 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 539/1055] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:38:16 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:16.770162 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:16.770778 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:16.782290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:16.782290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:16.782290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:16.782290 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:16.928400 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:16.935786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8115fa5c-0d3e-417c-b65b-61722955f474 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1574 microversion: 2.1 time: 0.170444 May 10 20:38:16.936354 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 517/1056] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:16 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:17.882347 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-8e28a8cf-8c14-4187-b956-df757bcd620e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba6fd81d-8eea-4998-bb3a-5d4cebff8d98"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:17.883426 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-8e28a8cf-8c14-4187-b956-df757bcd620e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:17.890123 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e28a8cf-8c14-4187-b956-df757bcd620e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:17.891089 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e28a8cf-8c14-4187-b956-df757bcd620e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:17.891883 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e28a8cf-8c14-4187-b956-df757bcd620e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:17.893077 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-8e28a8cf-8c14-4187-b956-df757bcd620e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:17.953560 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:17.954818 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:17.961343 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:17.961884 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:17.962679 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:17.963133 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:18.107472 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:18.115436 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ebd5ffa4-ffcc-41bb-aa28-cca33b995cde tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1574 microversion: 2.1 time: 0.165662 May 10 20:38:18.115993 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 518/1057] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:17 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:18.143745 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-8e28a8cf-8c14-4187-b956-df757bcd620e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265214 May 10 20:38:18.144547 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 540/1058] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:38:17 2022] POST /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:19.132954 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:19.134286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:19.141741 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:19.142269 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:19.143602 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:19.144049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:19.459717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:19.467259 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-4819e5d2-ae6f-4cc3-a702-9cd468892b20 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1561 microversion: 2.1 time: 0.338342 May 10 20:38:19.467945 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 519/1059] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:19 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1561 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:19.874321 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:19.875160 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:19.883023 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:19.883580 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:19.884466 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:19.885154 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:19.911438 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:38:19.936361 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-38a03c77-10cd-47ec-ab16-c4feece2a493 req-cf960b3d-560d-4dba-8136-4be567b104c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8", "tag": "7b8363ce-797d-4e6c-9ee6-edd52830ef17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:19.944223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-38a03c77-10cd-47ec-ab16-c4feece2a493 req-cf960b3d-560d-4dba-8136-4be567b104c4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:19.944671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-38a03c77-10cd-47ec-ab16-c4feece2a493 req-cf960b3d-560d-4dba-8136-4be567b104c4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:19.957733 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-38a03c77-10cd-47ec-ab16-c4feece2a493 req-cf960b3d-560d-4dba-8136-4be567b104c4 service nova] Creating event network-changed:7b8363ce-797d-4e6c-9ee6-edd52830ef17 for instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 on hv-cinder-82880 May 10 20:38:19.967657 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-38a03c77-10cd-47ec-ab16-c4feece2a493 req-cf960b3d-560d-4dba-8136-4be567b104c4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095266 May 10 20:38:19.968726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 520/1060] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:38:19.993149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d90178d0-f700-42d2-b4f7-8f4f8377636c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 204 len: 0 microversion: 2.1 time: 0.122979 May 10 20:38:19.993943 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 541/1061] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:38:19 2022] DELETE /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:38:20.003808 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:20.004915 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:20.011623 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:20.012231 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:20.013063 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:20.013511 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:20.153798 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:20.161935 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b02b3afc-5144-4897-9de3-3edf8c10f0dd tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1577 microversion: 2.1 time: 0.163414 May 10 20:38:20.162505 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 521/1062] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:19 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:21.180494 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:21.181224 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:21.187557 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:21.188020 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:21.188866 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:21.189515 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:21.325837 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:21.336602 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c81cf1a3-928e-450f-a89d-bfd3be654980 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1577 microversion: 2.1 time: 0.160180 May 10 20:38:21.337290 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 542/1063] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:21 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:38:22.111673 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-fe569e0a-fed8-425b-93e0-19c19e0e5b5d req-fccf10b1-3e9d-4a4b-9ff5-b0097b92509a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8", "name": "network-vif-deleted", "tag": "7b8363ce-797d-4e6c-9ee6-edd52830ef17"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:22.119840 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-fe569e0a-fed8-425b-93e0-19c19e0e5b5d req-fccf10b1-3e9d-4a4b-9ff5-b0097b92509a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:22.120329 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-fe569e0a-fed8-425b-93e0-19c19e0e5b5d req-fccf10b1-3e9d-4a4b-9ff5-b0097b92509a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:22.131258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-fe569e0a-fed8-425b-93e0-19c19e0e5b5d req-fccf10b1-3e9d-4a4b-9ff5-b0097b92509a service nova] Creating event network-vif-deleted:7b8363ce-797d-4e6c-9ee6-edd52830ef17 for instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 on hv-cinder-82880 May 10 20:38:22.136223 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-fe569e0a-fed8-425b-93e0-19c19e0e5b5d req-fccf10b1-3e9d-4a4b-9ff5-b0097b92509a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088295 May 10 20:38:22.137049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 522/1064] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:22.247897 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-5748b282-061b-404c-8684-c995a02c805e req-cf12518b-8de6-4153-8dfb-472088833820 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc43bb45-4300-4d9e-81e8-3ac1dfc77246", "name": "network-vif-plugged", "status": "completed", "tag": "33a5e6ed-c63a-4e5f-a910-096813ddde2b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:22.256309 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-5748b282-061b-404c-8684-c995a02c805e req-cf12518b-8de6-4153-8dfb-472088833820 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:22.256766 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-5748b282-061b-404c-8684-c995a02c805e req-cf12518b-8de6-4153-8dfb-472088833820 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:22.268231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-5748b282-061b-404c-8684-c995a02c805e req-cf12518b-8de6-4153-8dfb-472088833820 service nova] Creating event network-vif-plugged:33a5e6ed-c63a-4e5f-a910-096813ddde2b for instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 on hv-cinder-82880 May 10 20:38:22.273405 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-5748b282-061b-404c-8684-c995a02c805e req-cf12518b-8de6-4153-8dfb-472088833820 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029699 May 10 20:38:22.274053 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 543/1065] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:22.355338 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:22.356483 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:22.363589 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:22.364296 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:22.365524 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:22.365989 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:22.400022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:22.400480 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:22.401080 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lazy-loading 'fault' on Instance uuid 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:38:22.449431 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:22.459716 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-10abc3ae-a1e5-4c98-9871-9a72b8cf3b1c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 200 len: 1230 microversion: 2.1 time: 0.109878 May 10 20:38:22.460305 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 523/1066] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:22 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:23.477666 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:23.478397 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:23.484457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:23.484916 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:23.485718 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:23.486665 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:23.499531 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] HTTP exception thrown: Instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 could not be found. May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Request method failure captured: May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 HTTP/1.1 May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiestjjqsWupCZLQzvzeCyOmdiWgWqzCYUup5y-vXD1PJvvuPFHShl-ZbmQQXVAK1DcMrVdRRz6rR-XYIlekYi-RcSUiQYbruWQNMvc551Qp6Qdqh4N_JNLyGSMdwza6bssyr33ky6bHysNeBV_b-Bzd0-Qz6aSa37pTYEuj-QTisNPO4 May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:38:23.501162 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_890bf13c89b748b3a8f9ba4106c582b3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-TestVolumeBootPattern-170457138 May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 17f6eadae19c4b7b8bd66e21ae302363 May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 could not be found. May 10 20:38:23.503258 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8'} May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 could not be found. May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:38:23.504134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 could not be found. May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 could not be found. May 10 20:38:23.505792 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:23.507387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Returning 404 to user: Instance 4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:38:23.507387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d600f251-22ee-48dc-bd90-c639529112e8 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8" status: 404 len: 111 microversion: 2.1 time: 0.030123 May 10 20:38:23.507387 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 544/1067] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:23 2022] GET /compute/v2.1/servers/4e7107b0-57c8-48ab-be23-0d9c7d1ffcd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:38:25.629906 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba6fd81d-8eea-4998-bb3a-5d4cebff8d98"}} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:25.631011 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:25.637583 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.638062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:25.638835 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.639272 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:25.715204 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Invalid volume: volume ba6fd81d-8eea-4998-bb3a-5d4cebff8d98 is already attached to instances: 6ac587b8-5a1a-4955-9f6a-b8d63c638690 May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: POST /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments HTTP/1.1 May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 74 May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:38:25.716955 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {"volumeAttachment": {"volumeId": "ba6fd81d-8eea-4998-bb3a-5d4cebff8d98"}} May 10 20:38:25.718571 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Invalid volume: volume ba6fd81d-8eea-4998-bb3a-5d4cebff8d98 is already attached to instances: 6ac587b8-5a1a-4955-9f6a-b8d63c638690 May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'server_id': '6ac587b8-5a1a-4955-9f6a-b8d63c638690', 'body': {'volumeAttachment': {'volumeId': 'ba6fd81d-8eea-4998-bb3a-5d4cebff8d98'}}} May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ba6fd81d-8eea-4998-bb3a-5d4cebff8d98 is already attached to instances: 6ac587b8-5a1a-4955-9f6a-b8d63c638690 May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:25.719430 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ba6fd81d-8eea-4998-bb3a-5d4cebff8d98 is already attached to instances: 6ac587b8-5a1a-4955-9f6a-b8d63c638690 May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:25.721461 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ba6fd81d-8eea-4998-bb3a-5d4cebff8d98 is already attached to instances: 6ac587b8-5a1a-4955-9f6a-b8d63c638690 May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 400 to user: Invalid volume: volume ba6fd81d-8eea-4998-bb3a-5d4cebff8d98 is already attached to instances: 6ac587b8-5a1a-4955-9f6a-b8d63c638690 {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e08a606a-94d5-4ab7-992f-83d809df1460 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092535 May 10 20:38:25.722864 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 524/1068] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:38:25 2022] POST /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 20:38:25.778939 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:25.779444 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:25.785838 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.786296 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:25.787080 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.787529 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:25.867312 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.objects.instance [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lazy-loading 'services' on Instance uuid 6ac587b8-5a1a-4955-9f6a-b8d63c638690 {{(pid=117261) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:38:25.941400 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-36b7fc11-52bb-46ac-bdff-d3cf26355454 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments/ba6fd81d-8eea-4998-bb3a-5d4cebff8d98" status: 202 len: 0 microversion: 2.1 time: 0.166080 May 10 20:38:25.942011 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 545/1069] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:38:25 2022] DELETE /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments/ba6fd81d-8eea-4998-bb3a-5d4cebff8d98 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:38:25.950457 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e4d76407-121c-49cd-a21e-a9af67d8a28b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:25.951726 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e4d76407-121c-49cd-a21e-a9af67d8a28b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:25.958598 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e4d76407-121c-49cd-a21e-a9af67d8a28b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.959373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e4d76407-121c-49cd-a21e-a9af67d8a28b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:25.960246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e4d76407-121c-49cd-a21e-a9af67d8a28b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:25.960803 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e4d76407-121c-49cd-a21e-a9af67d8a28b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.006838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e4d76407-121c-49cd-a21e-a9af67d8a28b tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060257 May 10 20:38:26.007588 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 525/1070] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:38:25 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:26.609129 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:26.609719 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:26.616550 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-f5faed90-d6c8-4801-aac6-e7c5a39b157a req-301eb220-4255-404c-b769-4763ea79c8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee1365be-60d0-4cc7-b338-58257a75ab19", "tag": "ce64c984-b78b-4730-942e-62fd2c030058"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:26.616771 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:26.617490 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.618472 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:26.619077 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.628239 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-f5faed90-d6c8-4801-aac6-e7c5a39b157a req-301eb220-4255-404c-b769-4763ea79c8a4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:26.629168 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-f5faed90-d6c8-4801-aac6-e7c5a39b157a req-301eb220-4255-404c-b769-4763ea79c8a4 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.641321 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-f5faed90-d6c8-4801-aac6-e7c5a39b157a req-301eb220-4255-404c-b769-4763ea79c8a4 service nova] Creating event network-changed:ce64c984-b78b-4730-942e-62fd2c030058 for instance ee1365be-60d0-4cc7-b338-58257a75ab19 on hv-cinder-82880 May 10 20:38:26.649180 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-f5faed90-d6c8-4801-aac6-e7c5a39b157a req-301eb220-4255-404c-b769-4763ea79c8a4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035961 May 10 20:38:26.650030 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 526/1071] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:26.659337 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:38:26.777867 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-54d087ab-f1d6-4ad4-bfd3-dc9054aec765 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 204 len: 0 microversion: 2.1 time: 0.172525 May 10 20:38:26.778772 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 546/1072] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:38:26 2022] DELETE /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:38:26.788054 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:26.789312 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:26.796066 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:26.796606 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.797686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:26.798335 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:26.935629 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:26.944836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c29ec513-23ea-4885-a0fc-46a47f625013 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1578 microversion: 2.1 time: 0.160769 May 10 20:38:26.945510 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 527/1073] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:26 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:27.019013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b4438f29-983f-4942-8a64-8c2a63b7e9dc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:27.020908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b4438f29-983f-4942-8a64-8c2a63b7e9dc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:27.027441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b4438f29-983f-4942-8a64-8c2a63b7e9dc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.027892 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b4438f29-983f-4942-8a64-8c2a63b7e9dc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.028699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b4438f29-983f-4942-8a64-8c2a63b7e9dc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.028699 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b4438f29-983f-4942-8a64-8c2a63b7e9dc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.057982 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b4438f29-983f-4942-8a64-8c2a63b7e9dc tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043761 May 10 20:38:27.058544 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 547/1074] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:38:27 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:38:27.115477 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:27.115984 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:27.121821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.122280 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.123058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.123503 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.148241 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:38:27.230333 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-e59d49af-8376-4f7b-9545-44b5a5a514ae tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 204 len: 0 microversion: 2.1 time: 0.118303 May 10 20:38:27.230847 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 528/1075] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:38:27 2022] DELETE /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:38:27.239522 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:27.240294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:27.246421 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.246884 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.247683 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.248131 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.384733 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:27.395983 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-e2699d04-73ec-48de-8f75-c801350f5d7c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1679 microversion: 2.1 time: 0.160624 May 10 20:38:27.397428 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 548/1076] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:27 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:27.964005 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:27.964706 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:27.971177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.971632 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:27.972415 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:27.972885 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:28.110226 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:28.118238 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b3cab1d3-c158-44bb-bc09-7764ca6b871d tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1578 microversion: 2.1 time: 0.158427 May 10 20:38:28.118795 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 529/1077] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:27 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:28.416345 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:28.416960 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:28.423358 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:28.423831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:28.424600 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:28.425070 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:28.548460 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:28.555731 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-431ae696-6594-4bd4-b16f-c037fd13a78f tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1679 microversion: 2.1 time: 0.143238 May 10 20:38:28.556294 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 549/1078] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:28 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1679 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:29.135742 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:29.136224 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:29.143512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:29.143963 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:29.144737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:29.145464 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:29.275246 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:29.282600 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f69a2b82-0126-4643-b47e-b0577497a935 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1578 microversion: 2.1 time: 0.150835 May 10 20:38:29.283882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 530/1079] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:29 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:29.572483 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:29.573139 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:29.587545 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:29.588000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:29.588831 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:29.589307 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:29.817304 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:29.825675 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-1bb8291d-5102-4147-a9b3-cfc395d06585 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1679 microversion: 2.1 time: 0.257582 May 10 20:38:29.826384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 550/1080] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:29 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:30.080435 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-fd877625-a573-457d-aac2-786d1056be24 req-5e33ed9e-f931-47b6-8ab0-bd1363e0227a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee1365be-60d0-4cc7-b338-58257a75ab19", "name": "network-vif-deleted", "tag": "ce64c984-b78b-4730-942e-62fd2c030058"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:30.090655 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-fd877625-a573-457d-aac2-786d1056be24 req-5e33ed9e-f931-47b6-8ab0-bd1363e0227a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:30.091108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-fd877625-a573-457d-aac2-786d1056be24 req-5e33ed9e-f931-47b6-8ab0-bd1363e0227a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:30.104320 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-fd877625-a573-457d-aac2-786d1056be24 req-5e33ed9e-f931-47b6-8ab0-bd1363e0227a service nova] Creating event network-vif-deleted:ce64c984-b78b-4730-942e-62fd2c030058 for instance ee1365be-60d0-4cc7-b338-58257a75ab19 on hv-cinder-82880 May 10 20:38:30.109427 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-fd877625-a573-457d-aac2-786d1056be24 req-5e33ed9e-f931-47b6-8ab0-bd1363e0227a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033528 May 10 20:38:30.110500 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 531/1081] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:30.302101 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:30.302816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:30.309373 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:30.310044 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:30.310998 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:30.311605 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:30.385002 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f6eadae19c4b7b8bd66e21ae302363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890bf13c89b748b3a8f9ba4106c582b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:30.393709 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b02aabef-b4db-4ab5-9b89-d5619be226ff tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 200 len: 1391 microversion: 2.1 time: 0.096305 May 10 20:38:30.394752 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 551/1082] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:30 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 1391 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:30.844469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:30.845476 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:30.851796 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:30.852231 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:30.853050 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:30.853532 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:30.917113 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:30.924994 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6c916f06-d51b-4a22-854d-eb599715b0d5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 200 len: 1613 microversion: 2.1 time: 0.085907 May 10 20:38:30.925570 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 532/1083] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:30 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 1613 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:31.164915 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-845acd4a-0e54-45b2-95c9-192fecb23977 req-159b73aa-e019-4353-8349-68d7c1b2c3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ac587b8-5a1a-4955-9f6a-b8d63c638690", "name": "network-vif-deleted", "tag": "71d8f2d8-1dec-478b-b542-46bf66fbad3b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:31.182509 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-845acd4a-0e54-45b2-95c9-192fecb23977 req-159b73aa-e019-4353-8349-68d7c1b2c3e0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.183215 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-845acd4a-0e54-45b2-95c9-192fecb23977 req-159b73aa-e019-4353-8349-68d7c1b2c3e0 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.197179 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-845acd4a-0e54-45b2-95c9-192fecb23977 req-159b73aa-e019-4353-8349-68d7c1b2c3e0 service nova] Creating event network-vif-deleted:71d8f2d8-1dec-478b-b542-46bf66fbad3b for instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 on hv-cinder-82880 May 10 20:38:31.202997 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-845acd4a-0e54-45b2-95c9-192fecb23977 req-159b73aa-e019-4353-8349-68d7c1b2c3e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042277 May 10 20:38:31.208073 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 552/1084] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:31.411643 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:31.412194 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: ee1365be-60d0-4cc7-b338-58257a75ab19] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:31.418745 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.419207 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.420059 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.420512 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.434212 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] HTTP exception thrown: Instance ee1365be-60d0-4cc7-b338-58257a75ab19 could not be found. May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Request method failure captured: May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 HTTP/1.1 May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiestjjqsWupCZLQzvzeCyOmdiWgWqzCYUup5y-vXD1PJvvuPFHShl-ZbmQQXVAK1DcMrVdRRz6rR-XYIlekYi-RcSUiQYbruWQNMvc551Qp6Qdqh4N_JNLyGSMdwza6bssyr33ky6bHysNeBV_b-Bzd0-Qz6aSa37pTYEuj-QTisNPO4 May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:38:31.435866 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_890bf13c89b748b3a8f9ba4106c582b3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 17f6eadae19c4b7b8bd66e21ae302363 May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance ee1365be-60d0-4cc7-b338-58257a75ab19 could not be found. May 10 20:38:31.437344 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'ee1365be-60d0-4cc7-b338-58257a75ab19'} May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee1365be-60d0-4cc7-b338-58257a75ab19 could not be found. May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:38:31.438117 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee1365be-60d0-4cc7-b338-58257a75ab19 could not be found. May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee1365be-60d0-4cc7-b338-58257a75ab19 could not be found. May 10 20:38:31.439397 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.441746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Returning 404 to user: Instance ee1365be-60d0-4cc7-b338-58257a75ab19 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:38:31.441746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-2bbae486-7405-4b94-a335-aa7038ba0180 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19" status: 404 len: 111 microversion: 2.1 time: 0.029605 May 10 20:38:31.441746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 533/1085] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:31 2022] GET /compute/v2.1/servers/ee1365be-60d0-4cc7-b338-58257a75ab19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:38:31.891284 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:31.891880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:31.899091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.899538 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.900316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.900748 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.913805 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] HTTP exception thrown: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Request method failure captured: May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: DELETE /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 HTTP/1.1 May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiestjjqsWupCZLQzvzeCyOmdiWgWqzCYUup5y-vXD1PJvvuPFHShl-ZbmQQXVAK1DcMrVdRRz6rR-XYIlekYi-RcSUiQYbruWQNMvc551Qp6Qdqh4N_JNLyGSMdwza6bssyr33ky6bHysNeBV_b-Bzd0-Qz6aSa37pTYEuj-QTisNPO4 May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:38:31.915469 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_890bf13c89b748b3a8f9ba4106c582b3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 17f6eadae19c4b7b8bd66e21ae302363 May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.917013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9'} May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:38:31.917901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.919327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.920857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Returning 404 to user: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:38:31.920857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-b53ffa5c-02c7-40c8-a56a-b8774c0dd09c tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 404 len: 111 microversion: 2.1 time: 0.029822 May 10 20:38:31.920857 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 553/1086] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:38:31 2022] DELETE /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:38:31.925487 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:31.926103 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] [instance: a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:31.932067 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.932508 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.933311 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.933747 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.942720 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:31.943608 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:31.949227 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] HTTP exception thrown: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.950169 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.950704 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Request method failure captured: May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 HTTP/1.1 May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiestjjqsWupCZLQzvzeCyOmdiWgWqzCYUup5y-vXD1PJvvuPFHShl-ZbmQQXVAK1DcMrVdRRz6rR-XYIlekYi-RcSUiQYbruWQNMvc551Qp6Qdqh4N_JNLyGSMdwza6bssyr33ky6bHysNeBV_b-Bzd0-Qz6aSa37pTYEuj-QTisNPO4 May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:38:31.950836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_890bf13c89b748b3a8f9ba4106c582b3", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/890bf13c89b748b3a8f9ba4106c582b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 890bf13c89b748b3a8f9ba4106c582b3 May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-TestVolumeBootPattern-170457138 May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: 17f6eadae19c4b7b8bd66e21ae302363 May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-TestVolumeBootPattern-170457138-project May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.952158 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9'} May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:38:31.956671 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. May 10 20:38:31.958022 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:38:31.959232 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Returning 404 to user: Instance a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:38:31.959323 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:31.959323 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:31.959501 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c0ff81e8-b430-4b0b-9c0a-2b8c179a76d3 tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9" status: 404 len: 111 microversion: 2.1 time: 0.030510 May 10 20:38:31.959501 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 534/1087] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:31 2022] GET /compute/v2.1/servers/a87d6f9b-43b2-4ef1-9ed4-cc70ce0b08a9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:38:31.972216 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 HTTP/1.1 May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:38:31.974017 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:38:31.975695 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '6ac587b8-5a1a-4955-9f6a-b8d63c638690'} May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:38:31.976516 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:38:31.977972 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:38:31.979725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:38:31.979725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3707d24f-9522-4f81-8933-dda3be6121d2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 404 len: 111 microversion: 2.1 time: 0.037403 May 10 20:38:31.979725 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 554/1088] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:31 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 20:38:31.989758 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-680a9fcc-913a-4dce-b404-6c4bdc8b2ac7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '.version_select at 0x7fb278285790>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:32.009946 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-680a9fcc-913a-4dce-b404-6c4bdc8b2ac7 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-963001731" status: 202 len: 0 microversion: 2.1 time: 0.028934 May 10 20:38:32.010720 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 535/1089] 10.222.0.61 () {58 vars in 1217 bytes} [Tue May 10 20:38:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-963001731 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:38:32.642243 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c6d480c1-1955-48e3-8a39-0571a3923d72 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: .version_select at 0x7fb27348f0d0>, body: {"keypair": {"name": "tempest-keypair-630258746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwYl3d7e9ukAzTqYWI5AahYJZeQcvRUEjOQatURTyZ3522tUvRl/GOO9eqlaTzyhxRUN1SdlhUwGa1w5yWxwWW02T0ux3gvYPGJ2sReL5pAUEtAIPRd2y7103TZ1VfmiA=="}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:32.656424 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-c6d480c1-1955-48e3-8a39-0571a3923d72 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:38:32.660712 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-c6d480c1-1955-48e3-8a39-0571a3923d72 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'key_pairs'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:38:32.682152 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c6d480c1-1955-48e3-8a39-0571a3923d72 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043894 May 10 20:38:32.682744 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 555/1090] 10.222.0.61 () {60 vars in 1158 bytes} [Tue May 10 20:38:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:33.282600 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6fb26e0f-b18b-440e-b695-4ddf8cc8ff6f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] Calling method '.version_select at 0x7fb2782e98b0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:33.309100 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6fb26e0f-b18b-440e-b695-4ddf8cc8ff6f tempest-TestVolumeBootPattern-170457138 tempest-TestVolumeBootPattern-170457138-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-786161446" status: 202 len: 0 microversion: 2.1 time: 0.024410 May 10 20:38:33.310116 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 536/1091] 10.222.0.61 () {58 vars in 1259 bytes} [Tue May 10 20:38:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-786161446 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:38:33.878136 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1338446605", "imageRef": "19e46c64-0b25-4a85-9791-b1c7484ce88c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86bfbdf-9b8b-4914-a508-1afa24268f93"}], "security_groups": [{"name": "tempest-securitygroup--977227938"}], "key_name": "tempest-keypair-630258746", "user_data": "}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:33.981901 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.network.neutron [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] validate_networks() for [('e86bfbdf-9b8b-4914-a508-1afa24268f93', None, None, None, None, None)] {{(pid=117261) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 20:38:34.467976 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 20:38:34.468397 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image limits 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 20:38:34.469103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Flavor pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 20:38:34.469748 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Image pref 0:0:0 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 20:38:34.470371 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.virt.hardware [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117261) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 20:38:34.480021 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:34.480834 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:34.482064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:34.482568 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:34.500806 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 20:38:34.505159 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.quota [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Getting quotas for user d617f9658eb94f569568a5a729b14dff and project 24459511ae744b509a55faad8cd07970. Resources: {'cores', 'instances', 'ram'} {{(pid=117261) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 20:38:34.516182 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Going to run 1 instances... {{(pid=117261) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 20:38:34.519016 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='19e46c64-0b25-4a85-9791-b1c7484ce88c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117261) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 20:38:34.565245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-96fe62a6-b09c-4af0-9c9f-ed7d800715a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.692360 May 10 20:38:34.566064 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 556/1092] 10.222.0.61 () {60 vars in 1146 bytes} [Tue May 10 20:38:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 20:38:34.576393 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-a146f95e-acfc-4914-926f-a538911cba9c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:34.577040 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-a146f95e-acfc-4914-926f-a538911cba9c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:34.632471 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-a146f95e-acfc-4914-926f-a538911cba9c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:34.639414 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-a146f95e-acfc-4914-926f-a538911cba9c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1241 microversion: 2.1 time: 0.067431 May 10 20:38:34.639977 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 537/1093] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:34 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:35.657163 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:35.658938 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:35.666010 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:35.666470 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:35.667256 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:35.667694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:35.739477 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:35.746963 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-68ec68b0-86ba-4e16-b6e6-c38c11371939 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1299 microversion: 2.1 time: 0.093866 May 10 20:38:35.747634 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 557/1094] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:35 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:36.763686 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:36.764349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:36.775377 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:36.775836 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:36.776614 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:36.777076 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:37.007843 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:37.016995 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-8d25605b-c2a8-4001-b57e-bdccb0e59a11 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1366 microversion: 2.1 time: 0.256988 May 10 20:38:37.026752 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 538/1095] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:36 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:37.299892 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-6107cced-fbf9-47cc-85c0-545b6b41ba28 req-cf9a6faf-d28b-4d5b-a519-9a4d274a0c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad724415-9aa3-4e3b-9030-d5cc991a22ef", "tag": "ea442af7-cfed-42d9-99cc-4b2e0864f58b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:37.308926 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-6107cced-fbf9-47cc-85c0-545b6b41ba28 req-cf9a6faf-d28b-4d5b-a519-9a4d274a0c7a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:37.309659 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-6107cced-fbf9-47cc-85c0-545b6b41ba28 req-cf9a6faf-d28b-4d5b-a519-9a4d274a0c7a service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:37.323031 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-6107cced-fbf9-47cc-85c0-545b6b41ba28 req-cf9a6faf-d28b-4d5b-a519-9a4d274a0c7a service nova] Creating event network-changed:ea442af7-cfed-42d9-99cc-4b2e0864f58b for instance ad724415-9aa3-4e3b-9030-d5cc991a22ef on hv-cinder-82880 May 10 20:38:37.328006 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-6107cced-fbf9-47cc-85c0-545b6b41ba28 req-cf9a6faf-d28b-4d5b-a519-9a4d274a0c7a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031715 May 10 20:38:37.328880 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 558/1096] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:38.034891 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:38.035628 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:38.042183 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:38.042737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:38.043576 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:38.044091 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:38.245375 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:38.252610 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-d26f1dda-b181-46be-9456-4d57f805566e tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1366 microversion: 2.1 time: 0.222133 May 10 20:38:38.253205 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 539/1097] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:38 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:39.270320 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:39.271571 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:39.277849 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:39.278311 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:39.279314 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:39.279756 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:39.489103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:39.497668 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-78b16190-3ee6-4e6c-a97d-4c7e0ddbae42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1366 microversion: 2.1 time: 0.232220 May 10 20:38:39.498242 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 559/1098] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:39 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:40.514862 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:40.518843 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:40.525911 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:40.526454 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:40.527358 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:40.527881 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:40.680382 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:40.688286 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-cf50db79-7e7c-40cd-bc62-04ad7f800c9d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1366 microversion: 2.1 time: 0.177225 May 10 20:38:40.689261 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 540/1099] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:40 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:41.704760 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:41.705408 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:41.712096 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:41.712546 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:41.713339 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:41.713774 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:41.836128 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:41.843440 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-886ec9dc-7012-4210-aa26-8e28ebff5dd6 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1366 microversion: 2.1 time: 0.142529 May 10 20:38:41.844004 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 560/1100] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:41 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1366 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:42.298202 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [req-7ff802cf-71eb-451f-8904-009e9c13e4d6 req-f58dc351-740d-400b-913c-637ff14fb37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad724415-9aa3-4e3b-9030-d5cc991a22ef", "name": "network-vif-plugged", "status": "completed", "tag": "ea442af7-cfed-42d9-99cc-4b2e0864f58b"}]} {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:42.307109 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-7ff802cf-71eb-451f-8904-009e9c13e4d6 req-f58dc351-740d-400b-913c-637ff14fb37b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:42.307549 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [req-7ff802cf-71eb-451f-8904-009e9c13e4d6 req-f58dc351-740d-400b-913c-637ff14fb37b service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:42.319023 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.compute.server_external_events [req-7ff802cf-71eb-451f-8904-009e9c13e4d6 req-f58dc351-740d-400b-913c-637ff14fb37b service nova] Creating event network-vif-plugged:ea442af7-cfed-42d9-99cc-4b2e0864f58b for instance ad724415-9aa3-4e3b-9030-d5cc991a22ef on hv-cinder-82880 May 10 20:38:42.323967 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [req-7ff802cf-71eb-451f-8904-009e9c13e4d6 req-f58dc351-740d-400b-913c-637ff14fb37b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029536 May 10 20:38:42.324557 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 541/1101] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:38:42.859613 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:42.860180 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:42.866995 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:42.867441 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:42.868398 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:42.868841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:42.995927 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:43.003934 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-ff7937c4-dc99-4275-96d8-3ea5f97360d0 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1366 microversion: 2.1 time: 0.148202 May 10 20:38:43.004502 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 561/1102] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:42 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:44.022306 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:44.023018 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:44.029147 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:44.029604 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:44.030389 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:44.030830 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:44.159412 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:44.166623 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-28f00911-cdba-441e-85e1-5c3202332dd2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1366 microversion: 2.1 time: 0.149997 May 10 20:38:44.167182 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 542/1103] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:44 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:45.183830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:45.184478 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:45.192132 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:45.192591 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:45.193421 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:45.193879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:45.318052 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:38:45.325316 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-eed4b0ba-7bd4-43a6-8777-d026718206a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1556 microversion: 2.1 time: 0.145429 May 10 20:38:45.325896 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 562/1104] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:38:45 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:38:45.341399 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9462e395-7b4f-440b-924d-80a0fbc703ad tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:38:45.341898 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-9462e395-7b4f-440b-924d-80a0fbc703ad tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:38:45.348756 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9462e395-7b4f-440b-924d-80a0fbc703ad tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:45.349239 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9462e395-7b4f-440b-924d-80a0fbc703ad tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:45.350011 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9462e395-7b4f-440b-924d-80a0fbc703ad tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:45.350453 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-9462e395-7b4f-440b-924d-80a0fbc703ad tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:45.429828 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9462e395-7b4f-440b-924d-80a0fbc703ad tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092361 May 10 20:38:45.430494 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 543/1105] 10.222.0.61 () {58 vars in 1274 bytes} [Tue May 10 20:38:45 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:38:46.659582 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-387a45d7-6ce6-433e-ae23-85f5b193e652 req-92da184e-e0e9-4699-a33b-691e57d2236c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad724415-9aa3-4e3b-9030-d5cc991a22ef", "tag": "ea442af7-cfed-42d9-99cc-4b2e0864f58b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:38:46.668215 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-387a45d7-6ce6-433e-ae23-85f5b193e652 req-92da184e-e0e9-4699-a33b-691e57d2236c service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:38:46.668759 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-387a45d7-6ce6-433e-ae23-85f5b193e652 req-92da184e-e0e9-4699-a33b-691e57d2236c service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:38:46.682338 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-387a45d7-6ce6-433e-ae23-85f5b193e652 req-92da184e-e0e9-4699-a33b-691e57d2236c service nova] Creating event network-changed:ea442af7-cfed-42d9-99cc-4b2e0864f58b for instance ad724415-9aa3-4e3b-9030-d5cc991a22ef on hv-cinder-82880 May 10 20:38:46.687457 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-387a45d7-6ce6-433e-ae23-85f5b193e652 req-92da184e-e0e9-4699-a33b-691e57d2236c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031574 May 10 20:38:46.688173 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 563/1106] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:16.244740 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-c36e1bbe-8196-4cd2-83d3-580e76dd1970 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:16.245349 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-c36e1bbe-8196-4cd2-83d3-580e76dd1970 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:16.251424 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c36e1bbe-8196-4cd2-83d3-580e76dd1970 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:16.251880 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c36e1bbe-8196-4cd2-83d3-580e76dd1970 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:16.252659 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c36e1bbe-8196-4cd2-83d3-580e76dd1970 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:16.253155 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-c36e1bbe-8196-4cd2-83d3-580e76dd1970 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:16.275401 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-c36e1bbe-8196-4cd2-83d3-580e76dd1970 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/ips" status: 200 len: 149 microversion: 2.1 time: 0.035038 May 10 20:39:16.275960 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 544/1107] 10.222.0.61 () {58 vars in 1247 bytes} [Tue May 10 20:39:16 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:17.572346 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-3ae7bb36-e0a7-429a-89fb-d179a92015a9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ae685b1-e1c2-4e73-a473-95f009d706c3"}} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:39:17.573524 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-3ae7bb36-e0a7-429a-89fb-d179a92015a9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:17.579603 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ae7bb36-e0a7-429a-89fb-d179a92015a9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:17.580052 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ae7bb36-e0a7-429a-89fb-d179a92015a9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:17.580816 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ae7bb36-e0a7-429a-89fb-d179a92015a9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:17.581278 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-3ae7bb36-e0a7-429a-89fb-d179a92015a9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:17.806101 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-3ae7bb36-e0a7-429a-89fb-d179a92015a9 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "POST /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239238 May 10 20:39:17.806700 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 564/1108] 10.222.0.61 () {60 vars in 1322 bytes} [Tue May 10 20:39:17 2022] POST /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:24.313823 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:24.314360 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:24.320702 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:24.321205 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:24.321976 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:24.322417 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:24.399951 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lazy-loading 'services' on Instance uuid ad724415-9aa3-4e3b-9030-d5cc991a22ef {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:39:24.470074 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-3ebc871a-d2c6-4371-9e90-00741a130429 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments/5ae685b1-e1c2-4e73-a473-95f009d706c3" status: 202 len: 0 microversion: 2.1 time: 0.160077 May 10 20:39:24.470755 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 545/1109] 10.222.0.61 () {58 vars in 1415 bytes} [Tue May 10 20:39:24 2022] DELETE /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments/5ae685b1-e1c2-4e73-a473-95f009d706c3 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:39:24.480000 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-841b6651-2e35-42c8-81ae-c97d41375c95 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:24.481097 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-841b6651-2e35-42c8-81ae-c97d41375c95 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:24.488035 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-841b6651-2e35-42c8-81ae-c97d41375c95 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:24.489149 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-841b6651-2e35-42c8-81ae-c97d41375c95 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:24.490129 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-841b6651-2e35-42c8-81ae-c97d41375c95 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:24.490579 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-841b6651-2e35-42c8-81ae-c97d41375c95 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:24.521384 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-841b6651-2e35-42c8-81ae-c97d41375c95 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 May 10 20:39:24.522523 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 565/1110] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:39:24 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:39:25.534226 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f44ef7bf-de1f-4195-b594-97fd3aaa9085 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:25.535238 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-f44ef7bf-de1f-4195-b594-97fd3aaa9085 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:25.541857 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f44ef7bf-de1f-4195-b594-97fd3aaa9085 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.542316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f44ef7bf-de1f-4195-b594-97fd3aaa9085 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.543092 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f44ef7bf-de1f-4195-b594-97fd3aaa9085 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.543534 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-f44ef7bf-de1f-4195-b594-97fd3aaa9085 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.574668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f44ef7bf-de1f-4195-b594-97fd3aaa9085 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045128 May 10 20:39:25.575145 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 546/1111] 10.222.0.61 () {58 vars in 1301 bytes} [Tue May 10 20:39:25 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 20:39:25.630815 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:25.631353 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:25.637542 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.637991 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.638750 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.639180 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.665452 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Going to try to terminate instance {{(pid=117261) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:39:25.737596 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-87b6c4ff-8247-4f48-986e-bc10c0c70d42 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 204 len: 0 microversion: 2.1 time: 0.110939 May 10 20:39:25.738171 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 566/1112] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:39:25 2022] DELETE /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:39:25.747335 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:25.747974 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:25.753927 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.754380 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.755157 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:25.755599 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:25.880907 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:25.888316 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-7dc5fd25-9448-4a85-bf06-c4e3f579a1a5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1680 microversion: 2.1 time: 0.145139 May 10 20:39:25.889049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 547/1113] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:25 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1680 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:26.906621 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:26.907318 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:26.913638 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:26.914091 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:26.914873 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:26.915311 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:27.050736 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:27.058757 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-0c6e9b93-ef8c-4940-a806-a2ec228d0232 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1680 microversion: 2.1 time: 0.156369 May 10 20:39:27.059334 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 567/1114] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:26 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:28.076042 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:28.076668 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:28.083418 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:28.083882 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:28.084694 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:28.085179 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:28.163716 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd617f9658eb94f569568a5a729b14dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24459511ae744b509a55faad8cd07970', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:28.165214 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-e5d75561-867c-4e61-bd39-e98fdc235a5e req-8923c291-a02c-4ca2-b6ef-27e43473dc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad724415-9aa3-4e3b-9030-d5cc991a22ef", "name": "network-vif-deleted", "tag": "ea442af7-cfed-42d9-99cc-4b2e0864f58b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:39:28.173661 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-0b26dc3c-14b2-4573-96ce-19909e42bd49 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 200 len: 1613 microversion: 2.1 time: 0.101751 May 10 20:39:28.174572 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 548/1115] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:28 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:28.178260 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-e5d75561-867c-4e61-bd39-e98fdc235a5e req-8923c291-a02c-4ca2-b6ef-27e43473dc94 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:28.179040 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-e5d75561-867c-4e61-bd39-e98fdc235a5e req-8923c291-a02c-4ca2-b6ef-27e43473dc94 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:28.196694 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-e5d75561-867c-4e61-bd39-e98fdc235a5e req-8923c291-a02c-4ca2-b6ef-27e43473dc94 service nova] Creating event network-vif-deleted:ea442af7-cfed-42d9-99cc-4b2e0864f58b for instance ad724415-9aa3-4e3b-9030-d5cc991a22ef on hv-cinder-82880 May 10 20:39:28.202197 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-e5d75561-867c-4e61-bd39-e98fdc235a5e req-8923c291-a02c-4ca2-b6ef-27e43473dc94 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043875 May 10 20:39:28.203473 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 568/1116] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:39:29.191660 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:29.192852 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:29.199443 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:29.199949 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:29.200786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:29.201320 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:29.215118 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef HTTP/1.1 May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:39:29.216788 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:29.218525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'ad724415-9aa3-4e3b-9030-d5cc991a22ef'} May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:29.219458 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:29.220737 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:29.221937 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:29.221937 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-76e4db78-da68-42de-8433-61aa2beb615c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 404 len: 111 microversion: 2.1 time: 0.030540 May 10 20:39:29.221937 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 549/1117] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:29 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:29.228322 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4e88c13b-a1d9-4d8d-b22a-27f672d32ca2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '.version_select at 0x7fb27337c160>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:29.245025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4e88c13b-a1d9-4d8d-b22a-27f672d32ca2 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630258746" status: 202 len: 0 microversion: 2.1 time: 0.021391 May 10 20:39:29.245601 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 569/1118] 10.222.0.61 () {58 vars in 1217 bytes} [Tue May 10 20:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630258746 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 20:39:31.211770 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:31.212271 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:31.218337 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:31.218786 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:31.219563 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:31.220003 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:31.233301 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef HTTP/1.1 May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:39:31.234760 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.236373 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'ad724415-9aa3-4e3b-9030-d5cc991a22ef'} May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:31.240137 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.241708 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:31.243160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:31.243160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bb3eac73-68db-4be4-a8c1-7c14676d142d tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 404 len: 111 microversion: 2.1 time: 0.028889 May 10 20:39:31.243160 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 550/1119] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:39:31 2022] DELETE /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:31.245103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:31.245841 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: ad724415-9aa3-4e3b-9030-d5cc991a22ef] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:31.252533 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:31.253110 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:31.253994 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:31.254918 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:31.267747 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef HTTP/1.1 May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:39:31.269390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.271532 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'ad724415-9aa3-4e3b-9030-d5cc991a22ef'} May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:31.272705 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. May 10 20:39:31.274219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:31.275807 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance ad724415-9aa3-4e3b-9030-d5cc991a22ef could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:31.275807 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2f06c587-7f1c-47ef-ada1-db12c37e59f5 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef" status: 404 len: 111 microversion: 2.1 time: 0.030588 May 10 20:39:31.275807 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 570/1120] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:31 2022] GET /compute/v2.1/servers/ad724415-9aa3-4e3b-9030-d5cc991a22ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:32.401634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:32.402133 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:32.408363 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.408813 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.409614 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.410055 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.423062 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 HTTP/1.1 May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:39:32.424573 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.426215 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '6ac587b8-5a1a-4955-9f6a-b8d63c638690'} May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:32.427634 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.429127 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.430562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:32.430562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-bdbff4e3-b90c-46d2-a199-cbb8bda36d2c tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 404 len: 111 microversion: 2.1 time: 0.028181 May 10 20:39:32.430562 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 551/1121] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:39:32 2022] DELETE /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:32.435448 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:32.436067 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 6ac587b8-5a1a-4955-9f6a-b8d63c638690] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:32.443297 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.443759 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.444548 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.445035 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.460619 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 HTTP/1.1 May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:39:32.462170 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.463908 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '6ac587b8-5a1a-4955-9f6a-b8d63c638690'} May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:32.464721 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. May 10 20:39:32.466231 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.468830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance 6ac587b8-5a1a-4955-9f6a-b8d63c638690 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:32.468830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-7afd5e77-84b8-4ebc-b212-04c5acac0e00 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690" status: 404 len: 111 microversion: 2.1 time: 0.032038 May 10 20:39:32.468830 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 571/1122] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:32 2022] GET /compute/v2.1/servers/6ac587b8-5a1a-4955-9f6a-b8d63c638690 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:32.472256 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:32.472751 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:32.479217 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.479696 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.480459 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.480895 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.494518 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f HTTP/1.1 May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:39:32.496047 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.497719 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': 'b0f111b0-4604-45b5-a76d-3fa27630e35f'} May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:32.498587 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.500128 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:32.502012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:32.502012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ccc2f90a-403b-4073-8ee2-1dd187cdfff4 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 404 len: 111 microversion: 2.1 time: 0.029267 May 10 20:39:32.502012 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 552/1123] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:39:32 2022] DELETE /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:32.505607 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:32.506219 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: b0f111b0-4604-45b5-a76d-3fa27630e35f] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:32.512056 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.512506 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.513293 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:32.513731 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:32.526938 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f HTTP/1.1 May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:39:32.528435 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.530027 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'b0f111b0-4604-45b5-a76d-3fa27630e35f'} May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:32.531068 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. May 10 20:39:32.532569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:32.534225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance b0f111b0-4604-45b5-a76d-3fa27630e35f could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:32.534225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-4db4659e-e9f9-4eac-87db-2e3dcfe35208 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f" status: 404 len: 111 microversion: 2.1 time: 0.027902 May 10 20:39:32.534225 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 572/1124] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:32 2022] GET /compute/v2.1/servers/b0f111b0-4604-45b5-a76d-3fa27630e35f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:33.658575 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:33.659159 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:33.666049 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.666502 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.667278 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.667717 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.680940 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.wsgi [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: request: DELETE /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 HTTP/1.1 May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept: application/json May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Accept-Encoding: identity May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Connection: close May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Length: 0 May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Content-Type: application/json May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Host: 10.222.0.61 May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Openstack-System-Scope: None May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: User-Agent: python-urllib3/1.26.9 May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Id: None May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Domain-Name: None May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Identity-Status: Confirmed May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Is-Admin-Project: True May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Id: default May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Domain-Name: Default May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Role: member,reader May 10 20:39:33.682489 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Roles: member,reader May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Id: default May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Domain-Name: Default May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: method: > May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: exception: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.684058 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: action_args: {'id': '9f81a471-e87d-4336-aa77-0d7e92083006'} May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:33.685007 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.686463 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: ERROR nova.api.openstack.wsgi May 10 20:39:33.687838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. {{(pid=117260) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:33.687838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-ab839b90-14b3-48e7-8cd3-5d40a95bddcf tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 404 len: 111 microversion: 2.1 time: 0.029167 May 10 20:39:33.687838 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 553/1125] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:39:33 2022] DELETE /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:33.692038 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:33.692652 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] [instance: 9f81a471-e87d-4336-aa77-0d7e92083006] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:33.699442 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.699977 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.700879 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:33.701368 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:33.715103 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] HTTP exception thrown: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Request method failure captured: May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 HTTP/1.1 May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyTTtRvd1L27XHuB1v3YVwjoTiVeDMFpeQsijpTPPtteRR6djGZq-ixjobD-6GqGXVtU24TUr7lIZ5dAiXF913XUwuqnj9MBoTV8OFxFc7LUX3ADk909uMQPfu0HpShoME7w5cHDE8Fx1iyIL0Y_iH0psdOHgT6I04t_JFh0lmgj-c May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:39:33.716618 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/24459511ae744b509a55faad8cd07970"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_24459511ae744b509a55faad8cd07970", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/24459511ae744b509a55faad8cd07970"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 24459511ae744b509a55faad8cd07970 May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1499811591 May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: d617f9658eb94f569568a5a729b14dff May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-AttachVolumeNegativeTest-1499811591-project May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.718205 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': '9f81a471-e87d-4336-aa77-0d7e92083006'} May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:33.719088 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. May 10 20:39:33.720510 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:33.721835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] Returning 404 to user: Instance 9f81a471-e87d-4336-aa77-0d7e92083006 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:33.721835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-83627ef4-ebc4-43cc-8e63-fbd128edd877 tempest-AttachVolumeNegativeTest-1499811591 tempest-AttachVolumeNegativeTest-1499811591-project] 10.222.0.61 "GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006" status: 404 len: 111 microversion: 2.1 time: 0.029864 May 10 20:39:33.721835 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 573/1126] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:33 2022] GET /compute/v2.1/servers/9f81a471-e87d-4336-aa77-0d7e92083006 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:35.640258 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:35.641192 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:35.642210 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-31f18554-6c33-4ce0-8464-806023a02e56 req-2006a808-3c11-45a0-8467-64a3edc6ff88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc43bb45-4300-4d9e-81e8-3ac1dfc77246", "tag": "33a5e6ed-c63a-4e5f-a910-096813ddde2b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:39:35.650318 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.650908 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.651713 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.652203 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.655147 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-31f18554-6c33-4ce0-8464-806023a02e56 req-2006a808-3c11-45a0-8467-64a3edc6ff88 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.655862 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-31f18554-6c33-4ce0-8464-806023a02e56 req-2006a808-3c11-45a0-8467-64a3edc6ff88 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.670587 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-31f18554-6c33-4ce0-8464-806023a02e56 req-2006a808-3c11-45a0-8467-64a3edc6ff88 service nova] Creating event network-changed:33a5e6ed-c63a-4e5f-a910-096813ddde2b for instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 on hv-cinder-82880 May 10 20:39:35.675905 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-31f18554-6c33-4ce0-8464-806023a02e56 req-2006a808-3c11-45a0-8467-64a3edc6ff88 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039664 May 10 20:39:35.677673 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 574/1127] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:35.702556 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Going to try to terminate instance {{(pid=117260) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 20:39:35.804902 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-aa831033-2f75-4412-ac5f-399c13e96084 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 204 len: 0 microversion: 2.1 time: 0.171382 May 10 20:39:35.806177 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 554/1128] 10.222.0.61 () {58 vars in 1238 bytes} [Tue May 10 20:39:35 2022] DELETE /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 20:39:35.814656 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:35.815844 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:35.822340 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.822795 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.823586 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:35.824025 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:35.989902 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.policy [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117261) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:36.004389 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a60aaf5e-e6d4-4e08-83d9-88bab0493098 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.194001 May 10 20:39:36.017134 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 575/1129] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:35 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:37.027842 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:37.028553 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:37.035632 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:37.036821 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:37.037638 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:37.038082 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:37.182739 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:37.190311 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-00ad53f7-f71a-483d-889c-cab3fe324efd tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1567 microversion: 2.1 time: 0.166605 May 10 20:39:37.191054 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 555/1130] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:37 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:37.887327 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [req-8d6b20fe-5566-47f0-a448-f4b957908e02 req-68b6df91-7f85-484e-b06a-3ee4a5b6e074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc43bb45-4300-4d9e-81e8-3ac1dfc77246", "name": "network-vif-deleted", "tag": "33a5e6ed-c63a-4e5f-a910-096813ddde2b"}]} {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 20:39:37.901118 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-8d6b20fe-5566-47f0-a448-f4b957908e02 req-68b6df91-7f85-484e-b06a-3ee4a5b6e074 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:37.901578 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [req-8d6b20fe-5566-47f0-a448-f4b957908e02 req-68b6df91-7f85-484e-b06a-3ee4a5b6e074 service nova] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:37.930039 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.compute.server_external_events [req-8d6b20fe-5566-47f0-a448-f4b957908e02 req-68b6df91-7f85-484e-b06a-3ee4a5b6e074 service nova] Creating event network-vif-deleted:33a5e6ed-c63a-4e5f-a910-096813ddde2b for instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 on hv-cinder-82880 May 10 20:39:37.937536 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [req-8d6b20fe-5566-47f0-a448-f4b957908e02 req-68b6df91-7f85-484e-b06a-3ee4a5b6e074 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053508 May 10 20:39:37.940013 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 576/1131] 10.222.0.61 () {64 vars in 1317 bytes} [Tue May 10 20:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:39:38.208310 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:38.209758 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.compute.api [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117260) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:38.217111 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:38.217845 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:38.218914 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:38.219525 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:38.265220 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:38.265740 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG oslo_concurrency.lockutils [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117260) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:38.266477 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.objects.instance [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lazy-loading 'fault' on Instance uuid dc43bb45-4300-4d9e-81e8-3ac1dfc77246 {{(pid=117260) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 20:39:38.314998 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.policy [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676ded85a5b545939d26ddc630d1fac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61379b54bfc341878955a07870c5fda4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117260) authorize /opt/stack/nova/nova/policy.py:199}} May 10 20:39:38.324421 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-18acd567-85ec-4866-ac72-e5beabb5caf4 tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 200 len: 1223 microversion: 2.1 time: 0.120664 May 10 20:39:38.334650 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 556/1132] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:38 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 1223 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 20:39:39.343377 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:39.343993 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.compute.api [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] [instance: dc43bb45-4300-4d9e-81e8-3ac1dfc77246] Fetching instance by UUID {{(pid=117261) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 20:39:39.350176 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:39.350631 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:39.351429 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 20:39:39.351872 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG oslo_concurrency.lockutils [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Lock "163eff52-bb1b-4861-a806-bd9b77af6c50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117261) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 20:39:39.365330 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.wsgi [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] HTTP exception thrown: Instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 could not be found. May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Request method failure captured: May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: request: GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 HTTP/1.1 May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept: application/json May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Accept-Encoding: identity May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Connection: close May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Length: 0 May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Content-Type: application/json May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Host: 10.222.0.61 May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Openstack-System-Scope: None May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: User-Agent: python-urllib3/1.26.9 May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Auth-Token: gAAAAABiesyE0lkFIQmy19mAJWVLoLfffp3qJgykbQVLiXxIY3s0p8O3jalbjE0TBrV6ucyVyOYZUuIq8LPp8W60_fm05w1-qbEYsNdXeC-gidakY_yfKuFPhc1kHp0KC5RXhelF93xzmOkeZuEoLk8RCCt8xpOhwg0nTKEY9NskUGlt1QpNEGY May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Id: None May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Domain-Name: None May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Identity-Status: Confirmed May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Is-Admin-Project: True May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Id: default May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Domain-Name: Default May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Id: 61379b54bfc341878955a07870c5fda4 May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Project-Name: tempest-TestShelveInstance-2043880106 May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Role: member,reader May 10 20:39:39.366932 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Roles: member,reader May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61379b54bfc341878955a07870c5fda4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/61379b54bfc341878955a07870c5fda4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:8080/v1/AUTH_61379b54bfc341878955a07870c5fda4", "adminURL": "http://10.222.0.61:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/61379b54bfc341878955a07870c5fda4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}] May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant: tempest-TestShelveInstance-2043880106 May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Id: 61379b54bfc341878955a07870c5fda4 May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-Tenant-Name: tempest-TestShelveInstance-2043880106 May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User: tempest-TestShelveInstance-2043880106-project May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Id: default May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Domain-Name: Default May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Id: 676ded85a5b545939d26ddc630d1fac3 May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: X-User-Name: tempest-TestShelveInstance-2043880106-project May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: method: > May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: exception: Instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 could not be found. May 10 20:39:39.368465 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: action_args: {'id': 'dc43bb45-4300-4d9e-81e8-3ac1dfc77246'} May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 could not be found. May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 20:39:39.369380 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 could not be found. May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 could not be found. May 10 20:39:39.370649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: ERROR nova.api.openstack.wsgi May 10 20:39:39.371754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Returning 404 to user: Instance dc43bb45-4300-4d9e-81e8-3ac1dfc77246 could not be found. {{(pid=117261) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 20:39:39.371754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-d51c3fe5-e0f6-4499-bf30-04c67e45a21d tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246" status: 404 len: 111 microversion: 2.1 time: 0.029801 May 10 20:39:39.371754 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 577/1133] 10.222.0.61 () {58 vars in 1235 bytes} [Tue May 10 20:39:39 2022] GET /compute/v2.1/servers/dc43bb45-4300-4d9e-81e8-3ac1dfc77246 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 20:39:39.494616 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-6493d0ca-0756-4d64-bcbb-4e019743867e tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb27826f9d0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:39.529245 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-a6dc7412-2370-4436-9ead-3f1cd57cf1db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] Calling method '.version_select at 0x7fb2733a5c10>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:39.548509 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-a6dc7412-2370-4436-9ead-3f1cd57cf1db tempest-TestShelveInstance-2043880106 tempest-TestShelveInstance-2043880106-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-211257665" status: 202 len: 0 microversion: 2.1 time: 0.023382 May 10 20:39:39.549118 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 578/1134] 10.222.0.61 () {58 vars in 1250 bytes} [Tue May 10 20:39:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-211257665 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 20:39:39.559641 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-6493d0ca-0756-4d64-bcbb-4e019743867e tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/d574bada-fba0-4ee2-b83e-e480fda2c5f8" status: 200 len: 351 microversion: 2.1 time: 0.068509 May 10 20:39:39.566186 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 557/1135] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:39:39 2022] GET /compute/v2.1/os-volumes/d574bada-fba0-4ee2-b83e-e480fda2c5f8 => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:40.886720 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-2fca31b8-e6ad-434c-ba9e-b2fcb92fab57 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb273535e50>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:40.933275 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-2fca31b8-e6ad-434c-ba9e-b2fcb92fab57 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/8e395833-a2e1-459d-879e-806b0eccf29d" status: 200 len: 350 microversion: 2.1 time: 0.050611 May 10 20:39:40.933922 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 579/1136] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:39:40 2022] GET /compute/v2.1/os-volumes/8e395833-a2e1-459d-879e-806b0eccf29d => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:42.250731 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-1781ade3-c1ca-4c7d-95c5-b4ca443bc23b tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb2785fc8b0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.298798 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-1781ade3-c1ca-4c7d-95c5-b4ca443bc23b tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/0f1a5284-c364-44d5-aa6c-043764160449" status: 200 len: 351 microversion: 2.1 time: 0.052233 May 10 20:39:42.299374 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 558/1137] 10.222.0.61 () {58 vars in 1244 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes/0f1a5284-c364-44d5-aa6c-043764160449 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 20:39:42.310723 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-67c05931-25aa-4452-a07a-40cf1ce2b845 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb2735148b0>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.393261 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-67c05931-25aa-4452-a07a-40cf1ce2b845 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086668 May 10 20:39:42.393967 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 580/1138] 10.222.0.61 () {58 vars in 1133 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:42.406366 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-9722c391-77ca-4451-8a2c-51d8ab937d0e tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb2783e9ee0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.486642 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-9722c391-77ca-4451-8a2c-51d8ab937d0e tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083908 May 10 20:39:42.493818 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 559/1139] 10.222.0.61 () {58 vars in 1148 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:42.498907 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-f3b38733-2a4a-4456-9715-0ce205861ec7 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb2733feb80>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.607821 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-f3b38733-2a4a-4456-9715-0ce205861ec7 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.112565 May 10 20:39:42.608390 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 581/1140] 10.222.0.61 () {58 vars in 1133 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:42.619746 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-b2ed08ff-2f40-4012-b535-fb84d8cdd461 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb2785fc940>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.706883 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-b2ed08ff-2f40-4012-b535-fb84d8cdd461 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.091129 May 10 20:39:42.707449 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 560/1141] 10.222.0.61 () {58 vars in 1166 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:42.721493 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-c859c501-3b3f-4e52-87ab-65ceab2ab679 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb273410550>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.809211 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-c859c501-3b3f-4e52-87ab-65ceab2ab679 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093082 May 10 20:39:42.816569 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 582/1142] 10.222.0.61 () {58 vars in 1169 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:42.822514 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-fd1d6a8e-88c6-4abc-89c6-e8d821347342 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb27826fca0>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:42.908188 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-fd1d6a8e-88c6-4abc-89c6-e8d821347342 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090083 May 10 20:39:42.908765 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 561/1143] 10.222.0.61 () {58 vars in 1154 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:39:42.919939 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: DEBUG nova.api.openstack.wsgi [None req-975e61bd-4f95-46ff-a13a-0ed31da407b3 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb273535790>' {{(pid=117261) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:43.003237 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO nova.api.openstack.requestlog [None req-975e61bd-4f95-46ff-a13a-0ed31da407b3 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087036 May 10 20:39:43.004074 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: [pid: 117261|app: 0|req: 583/1144] 10.222.0.61 () {58 vars in 1187 bytes} [Tue May 10 20:39:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 20:39:43.016108 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: DEBUG nova.api.openstack.wsgi [None req-f725dcc3-89f5-493e-b129-c095c5dec154 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] Calling method '.version_select at 0x7fb2783ce160>' {{(pid=117260) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 20:39:43.098488 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO nova.api.openstack.requestlog [None req-f725dcc3-89f5-493e-b129-c095c5dec154 tempest-VolumesTestJSON-1121570663 tempest-VolumesTestJSON-1121570663-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086146 May 10 20:39:43.099240 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: [pid: 117260|app: 0|req: 562/1145] 10.222.0.61 () {58 vars in 1154 bytes} [Tue May 10 20:39:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 20:41:34.206745 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:41:34.207377 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Tue May 10 20:41:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:42:31.017859 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:42:31.018375 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Tue May 10 20:42:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:42:37.462977 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:42:37.463649 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Tue May 10 20:42:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:42:37.883415 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:42:37.883980 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Tue May 10 20:42:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:42:50.398469 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:42:50.399098 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Tue May 10 20:42:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:43:58.670786 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:43:58.671379 dv-cinder-828806-2-iscsi devstack@n-api.service[117261]: Tue May 10 20:43:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 20:44:54.216027 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 20:44:54.216659 dv-cinder-828806-2-iscsi devstack@n-api.service[117260]: Tue May 10 20:44:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!